Associate Data Engineer

Company Description

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters — to you, to your community, and to the world.

Progress starts with you.

Job Description

With data being the fuel that drives our future - our strategies, policies, and business successes around data will define our future growth prospects. Unlocking the value available through the innovative use of data on behalf of consumers, businesses, and communities is key to our future. With our ongoing commitment to Visa’s Data Values and the responsible use of data, we at Visa have a bold vision to continue to grow and accelerate our data-related businesses and capabilities.

Led by Visa’s first Chief Data Officer, the Global Data Office coordinates high-impact, complex, company-wide projects related to data business strategy, critical investments, policy development, and marketplace execution. Working closely with Visa’s Chief Privacy Officer, the Technology organization, the wider data community, and the full set of Visa’s global lines of business, the Global Data Office is evolving Visa’s data-related work with momentum and enthusiasm. Driven by its commitment to trusted use of data, Visa is seeking enthusiastic leaders who are change-agents and passionate about the future of data around the world.

About the Team

We are a Data Engineering team within GDO, responsible for designing, building, and optimizing data pipelines and platforms that power Visa’s analytics, and decisioning capabilities. Our focus is on data quality, scalability, and reliability, enabling seamless integration of complex datasets across regions. By partnering with product and business teams, we ensure that data-driven solutions deliver measurable impact and support Visa’s global innovation strategy.

About the role

• As a Data Engineer, you will be part of this core Data Engineering team, primarily working for the Visa Consulting & Analytics line of business.
• In this role, you will be responsible for building and running data pipelines to deliver analytical insights using data solutions to internal and external clients.
• This position will be in Bengaluru, reporting to the Senior Manager, Data Engineering.

Primary responsibilities:

• Build and manage large scale ETL processes to generate card level aggregated attributes.
• Ability to build modular and reusable codes considering the configurability and scalability while adhering to low-level design
• Perform thorough unit testing of each development task and document the test results using standard defined templates
• Build, schedule, and manage DAGs in Apache Airflow efficiently
• Monitor data processing tasks in the Data pipelines in Airflow
• Ensure quality control of data assets, reconciling data loaded across different stages in the data pipeline
• Utilize strong data analytics skills to identify, discuss, and promptly fix data issues
• Apply debugging skills to quickly rectify execution errors, ensuring minimal delays and impact on business operations
• Collaborate and communicate with stakeholders for requirement understanding and clarifications
• Maintain the highest level of quality and detail-oriented approach in daily tasks
• Adhere to agile principle and actively participate in all the scrum ceremonies

This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager. 

Qualifications

Basic Qualifications:
Bachelor's degree, OR 3+ years of relevant work experience

Preferred Qualifications:
Bachelor's degree, OR 3+ years of relevant work experience
1-3 years development experience in building data pipelines and writing ETL/ELT code using Hive, PySpark, SQL and Unix.
Build and manage large scale ETL processes to generate card level aggregated attributes.
Ability to build modular and reusable codes considering the configurability and scalability while adhering to low-level design
Perform thorough unit testing of each development task and document the test results using standard defined templates
Build, schedule, and manage DAGs in Apache Airflow efficiently
Monitor data processing tasks in the Data pipelines in Airflow
Ensure quality control of data assets, reconciling data loaded across different stages in the data pipeline
Utilize strong data analytics skills to identify, discuss, and promptly fix data issues
Apply debugging skills to quickly rectify execution errors, ensuring minimal delays and impact on business operations
Collaborate and communicate with stakeholders for requirement understanding and clarifications
Maintain the highest level of quality and detail-oriented approach in daily tasks
Adhere to agile principle and actively participate in all the scrum ceremonies
Experience in writing and optimizing SQL queries in Big data environment.
Experience working in Linux/Unix environment and exposure to command line utilities.
Experience creating/supporting production software/systems and a proven track record of identifying and resolving performance bottlenecks for production systems.
Preferred experience with Visualization Tools like Tableau, Power BI, D3 and exposure to code version control systems (git).
Strong communication skills
Ability to understand business requirements of the data science business
Good understanding of agile working practices and related program management skills.
Good communication and presentation skills with ability to interact with different cross-functional team members at varying levels

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.