Ähnliche Jobs

Large Language Models Evaluation

Large Language Models Evaluation

Large Language Models Evaluation

Large Language Models Evaluation

Fondazione Bruno Kessler

Forschung

Hub

  • Art der Anstellung: Vollzeit
  • 42.500 € – 55.000 € (von XING geschätzt)
  • Vor Ort
  • Letzte Chance

Large Language Models Evaluation

Über diesen Job

The Bruno Kessler Foundation is a research and innovation institution based in Trento. The Foundation operates in a plurality of disciplinary fields and aims to achieve excellence in science and technology through 2 science clusters, one dedicated to technology and innovation and one to humanities and social sciences, organized in 12 Research Centers, and with more than 450 researchers. For more information visit https://www.fbk.eu/it/chi-siamo/ .

In this context, the Intelligent Digital Agents Unit focuses on the study and development of flexible technologies and prototypes of digital assistants in the sector of prevention and mental well-being.

More information about IDA at https://ida.fbk.eu/home .

Planned activities

The IDA Unit of the Digital Health and Well Being Center is looking for a young recent graduate interested in pursuing an internship experience in performing qualitative evaluation of Large Language Models output. The ideal candidate is a proactive and dynamic young person with good organizational and interpersonal skills, with a propensity for teamwork, motivated to undertake a training experience in an international context.

The intern, working alongside the Research Unit staff, will mainly contribute to the development of the following activities:

  • deployment and usage of the major open LLMs available;
  • definition of qualitative metrics to evaluate LLMs output;
  • creation and/or refinement of existing benchmarks to use for LLMs evaluation;
  • assessing LLMs output on specific use cases and contexts;
  • The opportunity to join the team in other active and developing projects during the internship period and to gain experience in a dynamic and challenging environment such as FBK will also be offered.

Requirements

  • To be enrolled at least in the third year of a Computer Science or Linguistic faculty or equivalent. The possession of Master's degree in Computer Science or Linguistic or equivalent is a plus, but not mandatory;
  • knowledge of prompting techniques;
  • basic knowledge of qualitative evaluation procedures in Natural Language Processing
  • fluent knowledge of written and spoken Italian and English (min. level B1);
  • relational and teamwork skills;
  • good adaptability, flexibility and initiative skills;

Internship Information

  • Internship start date: as soon as the ideal candidate is found
  • Internship experience duration: 6 months
  • The internship experience will take place at the FBK venue at the Povo location
  • We offer support in finding accommodation at affiliated facilities, in the case of off-site candidates
  • We offer the possibility to use the internal canteen service
  • Possibility of linking the internship with bachelor or master thesis

How to Apply

All interested parties are asked to fill out the online form by clicking on "Apply Online" in the "Internship opportunities" section, attaching the following documents in .pdf format:

  • curriculum vitae
  • motivational letter

For any details about the internship activity, please contact: Leonardo Sanna ( lsanna@fbk.eu )

For any further information, please contact the Human Resources Department at: jobs@fbk.eu

Application deadline: the notice will be withdrawn when the desired applications are reached.

Gehalts-Prognose

Unternehmens-Details

company logo

Fondazione Bruno Kessler

Forschung

Povo, Italien

Wir benachrichtigen Dich gern über ähnliche Jobs in Hub:

Ähnliche Jobs

Doctoral Candidate (m/f/d)

Narr Francke Attempto Verlag GmbH + Co. KG

Graz

Doctoral Candidate (m/f/d)

Graz

Narr Francke Attempto Verlag GmbH + Co. KG

Universitätsassistent*in (PostDoc) im Bereich Combinatorial Probability

TU Graz

Graz

Universitätsassistent*in (PostDoc) im Bereich Combinatorial Probability

Graz

TU Graz

University Professor of Cryptology (m/f/d)

TU Graz

Graz

55.000 €65.500 €

University Professor of Cryptology (m/f/d)

Graz

TU Graz

55.000 €65.500 €

A Developer in the Field of Deep Learning for Weather and Climate Applications

Fondazione Bruno Kessler

Hub

38.500 €61.500 €

Neu · 

A Developer in the Field of Deep Learning for Weather and Climate Applications

Hub

Fondazione Bruno Kessler

38.500 €61.500 €

Neu · 

Tenure Track-Professur für Mathematical Foundations of Machine Learning

Universität Graz

Graz

Tenure Track-Professur für Mathematical Foundations of Machine Learning

Graz

Universität Graz

Tenure Track Professur für Forensische Bildgebung mit Schwerpunkt Angiographie

Medizinische Universität Graz

Graz

44.000 €51.000 €

Tenure Track Professur für Forensische Bildgebung mit Schwerpunkt Angiographie

Graz

Medizinische Universität Graz

44.000 €51.000 €

Statistik, operative wissenschaftliche Erfahrungen

Medizinische Medizinische Universität Innsbruck

Graz

45.500 €64.000 €

Statistik, operative wissenschaftliche Erfahrungen

Graz

Medizinische Medizinische Universität Innsbruck

45.500 €64.000 €

Senior Scientist Data- and Research Software Engineering (m/w/d)

Universität Graz

Graz

Neu · 

Senior Scientist Data- and Research Software Engineering (m/w/d)

Graz

Universität Graz

Neu · 

Universitätsassistent:in (Prae-Doc) im Bereich Computational Topology and Geometry

TU Graz

Graz

52.000 €60.500 €

Universitätsassistent:in (Prae-Doc) im Bereich Computational Topology and Geometry

Graz

TU Graz

52.000 €60.500 €