Research Engineer, Data Infrastructure
Posted 34 days ago
Job Description
This job posting has expired and no longer accepting applications.
By applying, you agree to our Applicant Privacy Policy.
You will help us move toward a future of decoupled control and data planes, scaling big data compute and storage platforms while ensuring secure and governed data access for MLOps and research. You will take full lifecycle ownership: from architecting the migration away from legacy orchestrators to implementing production-grade pipelines and participating in on-call rotations for critical training jobs.
- Build & Scale: Help us reach our goal of operating massive distributed compute and storage systems
- Global Orchestration: Architect and maintain multi-cluster orchestration layers to optimize workload placement across diverse hardware and regions.
- Design Future-Proof Storage: Architect our transition to modern storage formats to handle fine-tuning datasets at a scale that anticipates exabyte growth.
- Platform Engineering: Contribute to the development of our internal training platform, ensuring seamless model training and fine-tuning capabilities across Kubernetes and SLURM based environments.
- Metadata & Lineage: Implement and manage systems to provide clear visibility and lineage as our data and model pipelines grow in complexity.
- Operational Excellence: Use modern deployment workflows to manage cloud-native deployments, ensuring our data platform can scale by orders of magnitude while remaining reliable and efficient.
You might thrive in this role if you:
-
Have 4+ years of experience in Data Infrastructure, MLOps, or Infrastructure Engineering.
-
Have experience or a strong interest in supporting foundational compute and storage platforms.
-
Are proficient in Python and enjoy solving the "brittle data lake" problem with modern, columnar storage standards.
-
Are well-versed in Kubernetes-native tooling and excited to debug large-scale distributed systems across multi-cluster environments.
-
Take pride in building and operating scalable, reliable, and secure systems from the ground up.
-
Are comfortable with ambiguity and the challenges of building high-scale infrastructure in a rapid-growth AI environment.
This job posting has expired and no longer accepting applications. Please check out our latest AI jobs.
Mistral
8 jobs posted
About the job
Similar Jobs
21d
Research Engineer, Data Infrastructure
Mistral
Palo AltoResearch Engineer, Data Infrastructure
Mistral
Palo Alto21d28d
Research Engineer
Hedra
$175K - $275KSan Francisco, CAResearch Engineer
Hedra
$175K - $275KSan Francisco, CA28d28d
Research Engineer
Hedra
$175K - $275KSan Francisco, CAResearch Engineer
Hedra
$175K - $275KSan Francisco, CA28d19d
Research Engineer
Lightning AI
$180K - $250KLondon, England, United KingdomResearch Engineer
Lightning AI
$180K - $250KLondon, England, United Kingdom19d4d
Systems Research Engineer- Software Engineer, Data and ML Infrastructure
Feedzai
PortugalSystems Research Engineer- Software Engineer, Data and ML Infrastructure
Feedzai
Portugal4d28d
Research Engineer, Multimodal
Character AI
Redwood City, CAResearch Engineer, Multimodal
Character AI
Redwood City, CA28d28d
Research Engineer, LLMs
Mirage
$175K - $275KUnited StatesResearch Engineer, LLMs
Mirage
$175K - $275KUnited States28d20d
Research Engineer, Calibration
Waabi
Remote$158K - $269KSan Francisco, CAToronto, ON, CanadaPittsburgh, PARemote US & CanadaResearch Engineer, Calibration
Waabi
Remote$158K - $269KSan Francisco, CAToronto, ON, CanadaPittsburgh, PARemote US & Canada20d11d
Senior Research Engineer
Graphcore
Bristol, United KingdomCambridge, United KingdomLondon, United KingdomBristol, UKCambridge, UKLondon, UKSenior Research Engineer
Graphcore
Bristol, United KingdomCambridge, United KingdomLondon, United KingdomBristol, UKCambridge, UKLondon, UK11d11d
Senior Research Engineer
Graphcore
Bristol, United KingdomCambridge, United KingdomLondon, United KingdomBristol, UKCambridge, UKLondon, UKSenior Research Engineer
Graphcore
Bristol, United KingdomCambridge, United KingdomLondon, United KingdomBristol, UKCambridge, UKLondon, UK11d
AI jobs in your inbox
Get the latest AI jobs delivered to your inbox every week. Free, no spam.