Research Associate - AI Peer: Large language models (LLMs) and academic peer review outcomes

Summary: The University of Sheffield is seeking a Research Associate for the ESRC-funded Metascience project focused on evaluating academic peer review outcomes using Large Language Models (LLMs). The role involves managing surveys, processing research outputs, conducting statistical analyses, and organizing an international network of researchers. The successful candidate will also present findings at international meetings and contribute to the project's data management efforts.

Key Responsibilities:

• Liaise with managers to survey staff about their research outputs.
• Manage a survey to obtain permission for using research outputs in the study.
• Securely store and process research outputs through a Python pipeline for evaluation scores.
• Statistically analyze results and write them up for publication.
• Collaborate with project partners and manage an international network of researchers.
• Attend and present at international project meetings and conferences.
• Contribute to maintaining a well-organized shared file system and observe the project’s Data Management Plan.
• Make ethical decisions in line with the University sustainability strategy.
• Perform other duties commensurate with the grade of the post.

Key Skills:

• PhD (or equivalent) in Information Science or a relevant field.
• Experience in Python programming.
• Expertise in basic statistics.
• Knowledge of bibliometrics, scientometrics, research evaluation, or science policy.
• Excellent written and verbal communication skills.
• Ability to organize groups for shared tasks.
• Experience with Large Language Models or AI in research projects (desirable).
• Experience working with project partners (desirable).

Salary (Rate): £40,497.00

City: Sheffield

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: Other