Research Engineer, Language - Generative AI

About the Role

Meta is seeking a Research Engineer to join our Large Language Model (LLM) Research team. This team focuses on conducting research and engineering to build state-of-the-art LLMs, frequently contributing to open-source projects such as Llama 2. We are looking for highly skilled engineers with a robust background in generative AI and Natural Language Processing (NLP).

Ideal candidates will have experience in critical areas including language model evaluation; data processing for pre-training and fine-tuning; developing responsible LLMs; LLM alignment; reinforcement learning for language model tuning; efficient training and inference; and/or multilingual and multimodal modeling.

Research Engineer, Language - Generative AI Responsibilities

• Design methods, tools, and infrastructure to advance the state of the art in large language models.
• Define research goals that are informed by practical engineering concerns.
• Contribute to experiments, encompassing the design of experimental details, writing reusable code, running evaluations, and organizing results.
• Adapt standard machine learning methods to optimally utilize modern parallel environments, such as distributed clusters, multicore SMP, and GPU architectures.
• Collaborate effectively within a large and globally distributed team.
• Actively contribute to publications and open-sourcing efforts, sharing knowledge and advancements with the wider community.

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience.
• Proven research experience in machine learning, deep learning, and/or natural language processing.
• Experience with developing machine learning models at scale, from initial inception to demonstrable business impact.
• Proficiency in Python programming and hands-on experience with frameworks such as PyTorch.
• Exposure to architectural patterns of large-scale software applications.

Preferred Qualifications

• A PhD in AI, computer science, data science, or related technical fields.
• Master's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience.
• First author publications at peer-reviewed AI conferences (e.g., NeurIPS, CVPR, ICML, ICLR, ICCV, and ACL).
• Direct experience in generative AI and LLM research.

About Meta

Meta is at the forefront of building technologies that empower people to connect, find communities, and grow businesses. From the inception of Facebook in 2004, which revolutionized connection, to subsequent apps like Messenger, Instagram, and WhatsApp, Meta has consistently enabled billions worldwide. Today, Meta is pioneering immersive experiences in augmented and virtual reality, shaping the next evolution of social technology. Those who build their careers at Meta contribute to a future that transcends current digital connections, pushing beyond screens, distance, and even the laws of physics.

Meta is an Equal Employment Opportunity and Affirmative Action employer, committed to diversity and inclusion. We provide reasonable accommodations for candidates with disabilities; contact accommodations-ext@meta.com for assistance.

Key skills/competency

• Generative AI
• Large Language Models (LLMs)
• Natural Language Processing (NLP)
• PyTorch
• Distributed Systems
• Machine Learning
• Deep Learning
• AI Research
• Data Processing
• Reinforcement Learning
• LLM Alignment