Data Engineer - Sr. Consultant

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

• Lead architecture and delivery of large‑scale data platforms (ingestion, transformation, storage, metadata, lineage, quality, governed access)

• Design high‑volume batch and streaming pipelines (Spark/Flink/Kafka) with clear SLAs/SLOs, observability, and cost/performance targets for global transaction processing.

• Build and harden back‑end services and APIs (REST/gRPC authN/Z, rate limiting, quotas, resilience patterns) that power data products and model operations on Kubernetes.

• Partner with Product Team to translate requirements into secure, robust solutions be the team’s technical representative across forums and stakeholders.

• Drive proofs of concept to de‑risk tech choices quickly prototype, then lead or hand off for productionization with best practices.

• Champion engineering standards- CI/CD, TDD, data contracts, catalog/governance, PII handling, RBAC/ABAC, audit, retention.

• Establish domain‑oriented data models (warehouse/lakehouse/data mesh) and semantic layers enabling analytics

• Own reliability for pipelines and services: metrics, incident response, capacity planning, continuous improvement

• Mentor senior engineers and onboard new joiners foster mutual accountability and effective cross‑time‑zone collaboration.

• GenAI enablement- build/enhance RAG pipelines architect/optimize AI agents for planning/reasoning/acting integrate MCP tools/clients leverage LangChain/LangGraph contribute to prompt design and fine‑tuning.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

12+ years in data/software engineering with significant ownership of large‑scale, production‑grade systems Bachelor’s or advanced degree.
Strong back‑end experience: 3–5+ years building and operating production services (Java/Scala/Go/Python Spring Boot or equivalent REST/gRPC).
Big Data engineering: Hadoop/Spark, Python, SQL expert in ETL/ELT and maintaining scalable Spark pipelines.
Streaming/messaging: Kafka (Connect, schema registry, delivery semantics) familiarity with Hazelcast or similar in‑memory tech.
Containers/cloud/platform: Docker, Kubernetes, AWS (or GCP/Azure) Infra‑as‑Code (Terraform).
Orchestration and scheduling: Airflow, Control‑M (or equivalent) CI/CD with Git, Jenkins/GitHub Actions, Maven/Gradle.
Databases and modeling: relational (PostgreSQL/DB2), NoSQL (MongoDB/Cassandra) strong SQL and data modeling (star/snowflake, 3NF, domain‑driven).
Distributed systems and performance: familiarity with parallel/distributed architectures tuning and evaluation for large systems.
Observability: Prometheus/Grafana/OpenTelemetry metrics and operational excellence in high‑throughput environments.
Security/compliance: component security analysis, IAM/least‑privilege collaboration with security teams on risk and controls.
Practices: Agile/TDD code quality initiatives ability to work independently and across teams excellent communication and stakeholder partnership.
Leadership: proven technical leadership, cross‑org influence, mentoring passion, and ability to represent the team in technical forums.
GenAI expertise: experience with RAG pipelines, AI agents, MCP tools/clients, LangChain/LangGraph prompt crafting and contributions to model fine‑tuning for task performance and alignment.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.