Senior Research Engineer

Job Description

This job posting has expired and no longer accepting applications.

Luma’s mission is to build multimodal AI to expand human imagination and capabilities.We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.

We are looking for engineers with significant experience solving hard problems in PyTorch, CUDA and distributed systems. You will work with Research Scientists to build & train cutting edge foundation models on thousands of GPUs.

In addition to cash base pay, you'll also receive a sizable grant of Luma's equity.

The pay range for this position is for Bay Area. Base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience.

Startup Mindset

Value velocity and execution.

Communicate clearly.

Focus on building what will matter to users and the product.

Be resourceful at finding creative ways to overcome challenges.

Experience

Experience training large models using Python & Pytorch, including practical experience working with the full development pipeline from data processing, preparation & data loading to training and inference

Experience with profiling CPU & GPU code in PyTorch, including Nvidia Nsight or similar

Experience writing & improving highly parallel & distributed PyTorch code, with familiarity in DDP, FSDP, Tensor Parallel, etc.

Experience writing high-performance parallel C++. Bonus if done within an ML context with PyTorch, like for data loading, data processing, inference codeExperience with high-performance CUDA and writing custom PyTorch kernels. Top candidates will be able to utilize tensor cores; optimize performance with CUDA memory and other similar skills

Good to have experience working with Deep Learning concepts such as Transformers & Multimodal Generative models such as Diffusion Models and GANsBonus: Experience building inference / demo prototype code (incl. Gradio, Docker etc.)