Student Researcher (Multimodal Interaction and World Model - Seed) – 2027 Start (PhD)
ByteDance · San Jose, CA
- On site
- Internship
- $145,920 / year
- San Jose, CA
Job highlights
- Research multimodal foundation models and systems.
- Improve model capabilities across vision and language.
- Design and prototype algorithms and models.
- Collaborate on advancing research directions.
- Pursue PhD in computer science or related field.
About the role
About the Team
The Seed Multimodal Interaction and World Model team is dedicated to developing models that have human-level multimodal understanding and interaction capabilities. The team is working to advance the exploration and development of multimodal assistant products.
Responsibilities
- Conduct research on multimodal foundation models and related systems.
- Explore methods to improve model capabilities across modalities, including areas such as vision-language modeling, world modeling, and representation learning.
- Design and prototype algorithms, models, or system components.
- Collaborate with the team to advance research directions.
Minimum Qualifications
- Currently pursuing a PhD in computer science, mathematics, engineering, or a related field.
- Strong programming skills and solid foundation in algorithms and data structures, proficient in Python or C/C++.
- Demonstrated research track record with publications in conferences related to multimodal learning, machine learning, or artificial intelligence.
Preferred Qualifications
- Experience in multimodal modeling, vision-language modeling, world modeling, simulation, or 3D representations.
- Experience with latent space modeling or structured representations is a plus.
- Strong problem-solving ability and experience conducting independent research.
- Ability to collaborate effectively in a research environment.
Job Information - Compensation Description
The hourly rate range for this position is $60 - $60. Benefits may vary. Interns have day one access to health insurance, life insurance, wellbeing benefits and more. Interns also receive 10 paid holidays per year and paid sick time. Interns who are not working 100% remote may also be eligible for housing allowance.
About Doubao (Seed)
Established in 2023, the ByteDance Seed team is dedicated to pioneering new paths toward artificial general intelligence. We aspire to advance the frontier of intelligence to drive progress for both technology and society. The Seed team's research spans MLLM, GenMedia, AI for Science, and Robotics. We maintain a global presence with laboratories and career opportunities across China, Singapore, and the United States. Our technology powers over 50 application scenarios and serves enterprise customers through Volcano Engine and BytePlus.
Why Join ByteDance
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. We are committed to celebrating our diverse voices and creating an environment that reflects the many communities we reach.
Reasonable Accommodation
ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request
Key skills/competency
- Student Researcher
- Multimodal Interaction
- World Model
- Foundation Models
- Vision-Language Modeling
- Representation Learning
- Algorithm Design
- Machine Learning
- Artificial Intelligence
- Python
Skills & topics
- Student Researcher
- PhD
- Multimodal Interaction
- World Model
- Foundation Models
- Vision-Language Modeling
- Representation Learning
- Machine Learning
- Artificial Intelligence
- Python
- Computer Science
- Algorithms
- Data Structures
- Research Scientist
- AI Researcher
How to get hired
- Tailor your resume: Highlight your PhD research, publications, and programming skills in Python or C/C++.
- Showcase research impact: Emphasize your track record with publications in AI/ML conferences.
- Demonstrate technical proficiency: Detail experience with multimodal, vision-language, or world modeling.
- Prepare for technical interviews: Be ready to discuss algorithms, data structures, and AI concepts.
- Highlight collaboration skills: Mention your ability to work effectively in a research team.
Technical preparation
Behavioral questions
Frequently asked questions
- What are the core research areas for the Student Researcher position at ByteDance?
- The Student Researcher position at ByteDance focuses on multimodal foundation models, vision-language modeling, world modeling, and representation learning to advance multimodal assistant products.
- What qualifications are essential for the Student Researcher role at ByteDance?
- Essential qualifications include currently pursuing a PhD in a relevant field, strong programming skills in Python or C/C++, and a publication record in AI/ML conferences.
- Is prior experience in specific AI fields required for the ByteDance Student Researcher role?
- While not strictly required, preferred qualifications include experience in multimodal modeling, vision-language modeling, world modeling, simulation, or 3D representations.
- What is the expected compensation for this Student Researcher position at ByteDance?
- The hourly rate for this position is $60. Interns are also eligible for various benefits including health insurance, paid holidays, and potentially a housing allowance.
- Does ByteDance offer opportunities for remote work for Student Researchers?
- The job description mentions that interns not working 100% remote may be eligible for a housing allowance, suggesting remote work might be an option, but further clarification would be needed.
- What kind of projects can a Student Researcher expect to work on at ByteDance Seed team?
- Student Researchers can expect to work on developing models with human-level multimodal understanding and interaction capabilities, contributing to advancements in multimodal assistant products.
- How does ByteDance foster diversity and inclusion within its research teams?
- ByteDance is committed to creating an inclusive environment where employees are valued for their unique perspectives, celebrating diverse voices to reflect the global communities they serve.
- What is the application process for a Student Researcher at ByteDance?
- While specific details aren't provided, a typical application process involves submitting a resume, potentially a cover letter, and undergoing technical and behavioral interviews, with an emphasis on research experience.