Research Scientist - Embodied Intelligence

Pittsburgh, PA, Redmond, WA, Burlingame, CA

Job Description

At Meta Reality Labs, we’re developing advanced body encoding solutions and embodied agent systems with rich, multi-modal contextual understanding—enabling natural, expressive communication through realistic avatars. We are looking for a creative, skilled and motivated Research Scientist to build the core technologies that power seamless interactions for embodied agents. This includes developing state-of-the-art multi-modal LLMs for audio-visual understanding of users and behavior simulation, motion synthesis models that drive human-like movement for realistic avatars, and collaborating closely with avatar teams to ensure a cohesive, end-to-end user experience. You will work with research scientists, software engineers and hardware engineers to design technical solutions in a fast-paced, multidisciplinary environment.

Contribute to develop novel embodied agent systems for VR, MR and AR systems by applying and advancing state-of-the-art AI technologies

Consistently and sustainably advance the state of AI for your problem, including setting and executing against roadmaps for 6-month plus timeframes

Design and prototype interactive experiences and evaluate them through user research

Design and prototype data collection/curation framework to accelerate algorithm development

Collaborate and work across teams to develop and optimize end-to-end experiences

Minimum Qualifications

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

PhD degree in AI, computer science, data science, or related technical fields, or equivalent practical experience

2+ years of experience holding an industry, faculty, academic, or government researcher position

Publications in machine learning, computer vision, NLP, audio in peer-reviewed conferences (e.g. CVPR. ECCV, ICCV, NeurIPS, SIGGRAPH, ICML, ICLR, ICASSP)

Experience solving complex problems and comparing alternative solutions, tradeoffs to determine a path forward

Experience in training, fine-tuning, and/or experimenting with large language models

Proven ability to effectively collaborate with cross-functional teams

Preferred Qualifications

Experience with joint hardware-software development and associated rapid prototyping

Experience transferring technology from research in computer vision, machine perception or machine learning into a shipping product

Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub)

Experience building multi-modal LLM solutions with full development cycle in an industry setting

For those who live in or expect to work from California if hired for this position, please click here for additional information.

About Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

$147,000/year to $208,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity

Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.

Please mention that you found this job on MoAIJobs, this helps us grow. Thank you!