Principal AI Infrastructure Architect

Company Introduction  

We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did we ever live without Coupang?” Born out of an obsession to make shopping, eating, and living easier than ever, we’re collectively disrupting the multi-billion-dollar e-commerce industry from the ground up. We are one of the fastest-growing e-commerce companies that established an unparalleled reputation for being a dominant and reliable force in South Korean commerce.  

We are proud to have the best of both worlds — a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been since our inception. We are all entrepreneurs surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day. 

Our mission to build the future of commerce is real. We push the boundaries of what’s possible to solve problems and break traditional tradeoffs. Join Coupang now to create an epic experience in this always-on, high-tech, and hyper-connected world. 

The Opportunity

We are seeking a highly skilled and visionary Principal AI Infrastructure Architect to spearhead the design, construction, and management of our robust, scalable, and secure AI infrastructure. This is a pivotal role that will empower our cutting-edge Artificial Intelligence and Machine Learning initiatives, ensuring our platforms are reliable, cost-effective, and optimized for peak performance.
As the ideal candidate, you will be the crucial link between complex AI technologies and practical business applications. You will translate our strategic objectives into elegant and efficient infrastructure solutions, collaborating closely with a world-class team of data scientists, machine learning engineers, and software developers. If you are passionate about building the future of AI and thrive in a fast-paced, innovative environment, we want to hear from you.

What You’ll Do

• Architect the Future: Lead the end-to-end design and development of our AI infrastructure, encompassing hardware, software, networking, and multi-cloud environments

• Innovate and Evaluate: Assess, select, and implement the best-in-class technologies, tools, and frameworks (e.g., TensorFlow, PyTorch, Kubernetes, Docker) to build and maintain our AI platforms.

• Optimize for Performance: Engineer and implement infrastructure that scales seamlessly with our evolving AI/ML needs, continuously monitoring and optimizing for both performance and cost-efficiency.

• Champion Security and Compliance: Define and enforce infrastructure standards and best practices, ensuring unwavering compliance with security policies, data protection regulations, and ethical AI principles.

• Build Data-Driven Pipelines: Collaborate on the architecture and implementation of highly efficient data pipelines for our AI models, from ingestion and storage to processing and management.

• Lead and Inspire: Provide technical leadership and mentorship to cross-functional teams, fostering a culture of excellence and best practices in AI infrastructure.

• Solve Complex Challenges: Diagnose and resolve intricate infrastructure issues, ensuring the high availability and reliability of all our AI systems.

• Stay Ahead of the Curve: Keep your finger on the pulse of the latest advancements in AI, machine learning, and cloud computing, driving innovation within the organization.

• Document for Success: Create and maintain comprehensive documentation for all AI infrastructure designs, implementations, and operational procedures.

What You’ll Bring

• Education: A Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

• Experience:

  • 15+ years of experience in infrastructure architecture.

  • A minimum of 3-5 years of dedicated experience in designing and building AI-specific infrastructure.

  • Proven success in deploying scalable and secure AI solutions in cloud environments

  • Extensive, hands-on experience with containerization and orchestration technologies like Docker and Kubernetes.

• Technical Prowess:

  • Proficiency with the command line and experience with both cloud-native and on-premise data center deployments.

  • A strong understanding of deep learning architectures and the latest developments in Large Language Models (LLMs).

  • Expertise in NVIDIA hardware and software, including performance tuning and diagnostics.

  • Hands-on experience with GPU systems, including performance testing, tuning, and benchmarking.

  • Proficiency in programming languages such as Python.

  • A deep understanding of cloud service models (IaaS, PaaS, SaaS) and cloud-native architectures.

  • In-depth knowledge of networking, storage, and security best practices in a cloud context.

  • Experience with Infrastructure as Code (IaC) tools like Terraform or CloudFormation.

  • Familiarity with DevOps and MLOps principles and practices.

• Soft Skills:

  • Exceptional problem-solving and analytical abilities with a data-driven approach.

  • Excellent communication and interpersonal skills, capable of articulating complex technical concepts to diverse audiences.

  • Proven ability to lead, mentor, and collaborate effectively within a team environment.

  • A strategic mindset with the ability to align technical solutions with overarching business goals.

  • A proactive, adaptable, and continuous learner who thrives in a dynamic technological landscape.

Preferred Qualifications

• A deep understanding of the NVIDIA GPUs used in AI/ML applications and associated technologies like InfiniBand and NCCL.

• Experience building NVIDIA GPU-accelerated computing and specialized AI hardware.

• Knowledge of ethical AI practices and data governance.

Pay & Benefits

Our compensation reflects the cost of living across several US geographic markets. At Coupang, your base pay is one part of your total compensation.    

The base pay for this position ranges from $184,000/year in our lowest geographic market to $376,000/year in our highest geographic market. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.   

General Description of All Benefits (Drafter: Please check with your team if any change on the benefit description) 

• Medical/Dental/Vision/Life, AD&D insurance   
• Flexible Spending Accounts (FSA) & Health Savings Account (HSA)  
• Long-term/Short-term Disability  
• Employee Assistance Program (EAP) program  
• 401K Plan with Company Match  
• 18-21 days of the Paid Time Off (PTO) a year based on the tenure  
• 12 Paid Holidays  
• Paid Parental leave  
• Pre-tax commuter benefits  
• MTV - [Free] Electric Car Charging Station    

General Description of Other Compensation      

“Other Compensation” includes, but is not limited to, bonuses, equity, or other forms of compensation that would be offered to the hired applicant in addition to their established salary range or wage scale.    

Privacy Notice  

• Your personal information will be collected and managed by Coupang as stated in the Application Privacy Notice located below: https://www.coupang.jobs/privacy-policy/  

Coupang is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, or gender (including pregnancy, gender identity, gender expression, sexual orientation, transgender status), national origin, age, disability, medical condition, HIV/AIDS or Hepatitis C status, marital status, military or veteran status, use of a trained dog guide or service animal, political activities, or affiliations, citizenship, or any other characteristic or class protected by the laws or regulations in the locations where we operate. If you need assistance and/or reasonable accommodation in the recruiting process due to a disability, please contact us at usrecruiting@coupang.com.   

R0061802