Boson AI logo

Boson AI

Company

HPC Engineer, AI/ML Infrastructure

Santa Clara HQ

Job Description

About The Role

We're looking for a Senior High Performance Computing Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.

You'll be hands-on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You'll also help us plan for future capacity and evaluate new technologies as we continue to scale.
About The Role

We're looking for a Senior High Performance Computing Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.

You'll be hands-on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You'll also help us plan for future capacity and evaluate new technologies as we continue to scale.

Responsibilities

  • Manage and optimize HPC cluster operations
  • Deploy and maintain infrastructure-as-code solutions
  • Support ML/research teams with cluster usage optimization
  • Operate, troubleshoot and optimize Ceph storage clusters.
  • Develop automation and tooling
  • Minimum Qualifications

  • 5+ years of experience in HPC operations.
  • Proficiency in Linux systems administration (Ubuntu/Debian).
  • Experience with Kubernetes and container orchestration
  • Knowledge of security best practices in multi-tenant environments.
  • Understanding of L2/L3 networking fundamentals
  • Skilled in Python and Bash scripting.
  • Preferred Qualifications

  • Experience with infrastructure-as-code tools (Ansible/Terraform).
  • Experience with Ceph >1PB deployments and maintenance
  • Experience with GitOps (Helm, ArgoCD).
  • Strong grasp of RDMA, InfiniBand, and GPUDirect technologies
  • Familiarity with deep learning frameworks such as PyTorch and TensorFlow.
  • Familiarity in at least one cloud platform: AWS, Azure or GCP.
  • If you're a natural problem-solver with a passion for continuous learning, we'd love to hear from you.

    Please mention that you found this job on MoAIJobs, this helps us grow. Thank you!

    Boson AI logo

    Boson AI

    4 jobs posted

    View all Boson AI jobs

    About the job

    Posted on

    Nov 5, 2025

    Apply before

    Dec 5, 2025

    Job typeFull-time

    Share this job opportunity