Software Engineer, AI Agent

Mountain View, California, United States

Responsibilities

• Design and develop backend infrastructure for AI Agent products, including APIs, databases, caching, and task orchestration
• Implement Agent execution logic — context management, tool invocation, model coordination, and workflow tracking
• Integrate multiple foundation models and external data or API sources
• Optimize system throughput, latency, and reliability for scalable deployment
• Collaborate cross-functionally with product and ML teams to iterate quickly on AI-driven features

Requirements

• Bachelor’s degree or higher in Computer Science, Software Engineering, or related fields;
• Strong backend engineering experience in Python (or Go / Node.js), including API design, database modeling, and middleware such as Redis / Kafka / MQ;
• A power user or active builder of AI products, with a deep understanding of AI interaction patterns and system behaviors;
• Familiar with major foundation models (OpenAI, Anthropic, Gemini, Llama, Mistral, etc.) and their APIs, context limits, and response styles;
• Experience in Context Engineering / RAG / Prompt Engineering, with understanding of how retrieval and context design affect model performance;
• Solid skills in system design, debugging, and production readiness.

Preferred Qualifications:

• Experience with model fine-tuning / LoRA / RLHF;
• Basic frontend development experience (React, Next.js, or Vue);
• Hands-on experience building or launching AI Agent products from scratch;
• Familiarity with LLM orchestration frameworks (LangChain, LlamaIndex, SGLang, vLLM, FastAPI, etc.).

Benefits

We offer a competitive benefits package:

• Health, dental, and vision care for you and your family (100% coverage for employee)
• Top-tier 401(K) plan with company matching
• Paid time off and paid holidays
• FSA, HSA and commuter benefits programs
• Team activity budget