All Jobs
Senior AI Ops Engineer

Senior AI Ops Engineer

Posted 6 days ago

Job Description

Why should you join dLocal?

dLocal enables the biggest companies in the world to collect payments in 40 countries in emerging markets. Global brands rely on us to increase conversion rates and simplify payment expansion effortlessly. As both a payments processor and a merchant of record where we operate, we make it possible for our merchants to make inroads into the world’s fastest-growing, emerging markets.

By joining us you will be a part of an amazing global team that makes it all happen. Being a part of dLocal means working with 1000+ teammates from 30+ different nationalities and developing an international career that impacts millions of people’s daily lives. We are builders, we never run from a challenge, we are customer-centric, and if this sounds like you, we know you will thrive in our team.

What's the Opportunity?

The AI Ops Engineer is a highly technical role responsible for the reliability, scalability, and continuous improvement of dLocal’s AI ecosystem across the entire organization. As AI adoption expands company-wide, we need a hands-on expert who can operate, maintain, evaluate, and evolve our AI systems in production—ensuring consistent quality, robustness, security, and measurable business impact for teams across dLocal.

In this role, you will act as both an enabler and a technical authority. You will work alongside Engineering and cross-functional teams to ensure our AI systems—built both in-house and leveraging best-in-class third-party tools—operate at the highest standards of performance and efficiency. You will maintain and customize AI-powered information systems, including prompt libraries, skills frameworks, orchestration layers, integrations, evaluation pipelines, and observability tooling.

This position requires strong analytical capabilities, deep systems thinking, and the ability to rigorously compare models, architectures, and tools to consistently achieve the best possible outcomes

What Will I Be Doing?

Operate & Maintain AI Systems: Ensure reliability, scalability, and observability of AI-powered services deployed on AWS, including LLM-based systems and agentic workflows used across the organization.

Architect Agent Behavior: Design and version-control complex system prompts, ensuring agents have clear personas, robust guardrails, and precise tool definitions.

Curate Knowledge Context: Manage the "Golden Corpus" for our agents and RAG systems, optimizing data chunking and metadata strategies to ensure accurate information retrieval and proper execution context.

Architect & Optimize AI Workflows: Design and continuously improve prompt libraries, skills repositories, orchestration frameworks, and automation pipelines that power internal AI tools.

Model Evaluation & Benchmarking: Evaluate and compare AI models (LLMs and foundation models) across quality, latency, cost, safety, and robustness.

Implement Automated Evals: Build "Ground Truth" datasets and design "LLM-as-a-Judge" pipelines to rigorously test agent performance before deployment.

Enablement & Best Practices: Provide reusable components, documentation, and operational standards that empower engineering teams and internal stakeholders to safely leverage AI capabilities.

Experimentation & Continuous Improvement: Drive structured experimentation cycles (A/B testing, offline evals, shadow testing) to iteratively improve system performance.

Governance & Guardrails: Implement versioning strategies, access controls, auditability, and responsible AI guardrails aligned with a regulated fintech environment.

What Skills Do I Need?

Technical Background: Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).

5+ Years of Experience: Experience in ML Engineering, Data Science, AI Engineering, Platform Engineering, or related roles with proven responsibility for ensuring the reliability, performance, and operational excellence of AI and Machine Learning systems in production environments.

AI & LLM Expertise: Practical experience working with LLMs, RAG architectures, embeddings, prompt engineering, evaluation frameworks, and inference trade-offs. Deep familiarity with LLM concepts such as tokenization, temperature, context windows, and latent representations.

Operations & Observability: Experience with CI/CD for AI systems, model versioning, experiment tracking, performance monitoring, and incident response.

Analytical & Comparative Mindset: Strong ability to evaluate competing AI systems, vendors, and architectures using measurable performance indicators.

Data-Driven Mindset: Experience with AI observability and evaluation platforms (e.g., LangSmith, Arize, HoneyHive) to drive improvements through structured metrics rather than intuition.

Builder Mentality: Comfortable maintaining and customizing AI information systems, including prompt repositories, skills libraries, orchestration tools, no-code/low-code platforms (e.g., n8n, Zapier, Replit, Glean), and system integrations.

Security & Compliance Awareness: Understanding of secure system design, data privacy, and operational controls within financial or regulated environments.

Collaborative Spirit: Proven ability to act as the connective layer between Engineering, Product, Data, and business stakeholders.

What do we offer?

Besides the tailored benefits we have for each country, dLocal will help you thrive and go that extra mile by offering you:

- Flexibility: we have flexible schedules and we are driven by performance.

- Fintech industry: work in a dynamic and ever-evolving environment, with plenty to build and boost your creativity.

- Referral bonus program: our internal talents are the best recruiters - refer someone ideal for a role and get rewarded.

- Social budget: you'll get a monthly budget to chill out with your team (in person or remotely) and deepen your connections!

- dLocal Houses: want to rent a house to spend one week anywhere in the world coworking with your team? We’ve got your back!

Flexibility in how you work: We focus on impact and productivity over fixed hours. This means our teams have flexible schedules and, depending on your role and location, you will combine self‑managed focus time with moments of in‑person connection in our collaboration hubs.

What happens after you apply?

Our Talent Acquisition team is invested in creating the best candidate experience possible, so don’t worry, you will definitely hear from us. We will review your CV and keep you posted by email at every step of the process!

Also, you can check out our webpage, Linkedin and Youtube for more about dLocal!

Please mention that you found this job on MoAIJobs, this helps us grow. Thank you!