Senior Machine Learning Engineer, Vehicle Perception

Job Description

About Woven by Toyota

Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.

Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.

=========================================================================

TEAM

The Vehicle Perception team at Woven by Toyota tackles the core challenges of machine learning for 3D perception, sensor fusion, and computer vision in autonomous vehicles. Our work involves a variety of challenges, such as analyzing petabytes of multimodal driving data, solving optimization problems in computer vision, minimizing latency on hardware accelerators, deploying scalable and efficient machine learning (ML) training and evaluation pipelines, and designing novel neural network architectures to advance state-of-the-art ML for onboard perception. We are looking for doers and creative problem solvers to join us in improving mobility for everyone with human-centered automated driving solutions for personal and commercial applications.

WHO ARE WE LOOKING FOR?

The team is looking for a skilled Machine Learning Engineer to help advance a cutting-edge machine learning system for perception foundation models leveraging large-scale multimodal sensor data. You will have the chance to design and implement innovative machine learning models for our next-generation autonomous vehicle platform, influencing millions of Toyota production vehicles. We are looking for individuals who are passionate about self-driving car technology and its potential impact on humanity. Furthermore, we highly value candidates who exhibit a "giver" mindset, consistently seeking opportunities to assist their colleagues while maintaining a strong focus on delivering solutions to production.

RESPONSIBILITIES

Lead the design and development of perception foundation models for autonomous vehicles, unifying diverse sensor data for scalable 3D scene understanding

Deploy scalable and efficient ML models on our autonomous vehicle platform

Integrate modern technologies with rigorous safety standards while maintaining cost efficiency

Significantly contribute to development of needed components for end-to-end ML training and deployment, from data strategy to optimization and validation

Be a champion of the scientific method and critical thinking in inventing state-of-the-art deep learning solutions

Work in a high-velocity environment and employ agile development practices

Collaborate closely with teams such as Perception, Motion Planning, Simulation, Infrastructure, and Tooling to drive unified solutions

Work in a hybrid workspace, with the requirement to be present in our Nihonbashi (Japan), Palo Alto (California), or Ann Arbor (Michigan) offices three days per week

MINIMUM QUALIFICATIONS

MS or PhD in Machine Learning, Computer Vision, Robotics or related quantitative fields, or equivalent industry experience

(3+ years of) experience with Python, any major deep learning framework, and software engineering best practices

(3+ years of) experience with deep learning approaches such as supervised/unsupervised learning, transfer learning, multi-task learning, and/or deep reinforcement learning

(3+ years of) experience covering machine learning workflows, data sampling and curation, pre-processing, model training, ablation studies, evaluation, deployment, and inference optimization

Deep understanding of runtime complexity, distributed/cloud ML infrastructure, data pipeline architecture, and resource-aware optimization

Comfortable in writing C++ code to help integrate with our autonomous vehicle platform

Strong leadership skills to influence others and the team's technical strategy

Strong communication skills with the ability to communicate concepts clearly and precisely

NICE TO HAVES

Published research at top-tier conferences (NeurIPs, CVPR and similar)

Proven track record of deploying ML models at scale in self-driving or related fields

Familiarity with production-level coding and deployment onto embedded platforms, optimizing for latency and hardware constraints

Experience working with large-scale foundation models, including pretraining, multimodal architectures, self-supervised learning approaches

Experience with computer vision (e.g. multi-view geometry, camera calibration, depth estimation, neural radiance fields, gaussian splatting, simultaneous localization and mapping)

Experience in self-driving challenges (Perception, Prediction, Mapping, Localization, Planning, Simulation)

=========================================================================

Important Points

・All interviews will be arranged via Google Meet, unless otherwise stated.

・The same job descriptions are available in both English and Japanese; therefore, we kindly ask that you apply to only one version.

・We kindly request that you submit your resume in English, if possible. However, Japanese resumes are also acceptable. Please note that, depending on the English proficiency requirements of the role, we may request an English version of your resume later in the process.

WHAT WE OFFER

・Competitive Salary - Based on experience

・Work Hours - Flexible working time

・Paid Holiday - 20 days per year (prorated)

・Sick Leave - 6 days per year (prorated)

・Holiday - Sat & Sun, Japanese National Holidays, and other days defined by our company

・Japanese Social Insurance - Health Insurance, Pension, Workers’ Comp, and Unemployment Insurance, Long-term care insurance

・Housing Allowance

・Retirement Benefits

・Rental Cars Support

・In-house Training Program (software study/language study)

Our Commitment