Sr. SW Test Engineer (3-5 years of experience in Big Data Testing, Pyspark, ETL Testing, SQL)
Posted 1 day ago
Job Description
Company Description
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.
At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters — to you, to your community, and to the world.
Progress starts with you.
Job Description
We are seeking a highly skilled Senior Software Test Engineer with deep functional knowledge of financial systems to lead the automation of data quality validation across large-scale data pipelines processing petabytes of data.
As part of the Finance Data Platform, you will design, build, and maintain scalable, automated testing frameworks that ensure the integrity, accuracy, and reliability of critical financial data. Your expertise in PySpark, Python, SQL, and Hive will be central to driving data quality standards across our enterprise data ecosystem.
This is a hybrid role. In-office expectations will be confirmed by the hiring manager.
Key Responsibilities
- Design, develop, and maintain automated data quality checks for complex, petabyte-scale data pipelines.
- Build scalable data validation frameworks using PySpark, PyTest, Python, SQL, and Hive, ensuring comprehensive test coverage.
- Partner with Data Engineering and DevOps teams to integrate automated testing into CI/CD pipelines.
- Analyse test results to identify data anomalies, root causes, and remediation strategies.
- Develop and maintain production monitoring and alerting solutions for data quality.
- Document testing standards, frameworks, and best practices, and mentor junior engineers in data quality automation.
- Continuously enhance test frameworks to improve performance, scalability, and reliability.
Qualifications
3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)
Additional Information
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Visa
123 jobs posted
About the job
Similar Jobs
1d
Data Engineer (1-2 years of experience in Big Data, Python, Pyspark, SQL)
Visa
Bengaluru, IndiaData Engineer (1-2 years of experience in Big Data, Python, Pyspark, SQL)
Visa
Bengaluru, India1d16d
Sr. Big Data Engineer
Databricks
RemoteIndiaSr. Big Data Engineer
Databricks
RemoteIndia16d13d
Software Engineer (Big Data)
Quantcast
$145K - $168KSan Francisco, CASoftware Engineer (Big Data)
Quantcast
$145K - $168KSan Francisco, CA13d20d
Product Analyst, Merchant Data Platform (Data Analysis, SQL, Big Data Skills, Stakeholder management)
Visa
Bangalore, IndiaProduct Analyst, Merchant Data Platform (Data Analysis, SQL, Big Data Skills, Stakeholder management)
Visa
Bangalore, India20d17d
Big Data Solutions Architect (Professional Services)
Databricks
Paris, FranceBig Data Solutions Architect (Professional Services)
Databricks
Paris, France17d23d
Big Data Platform & Distributed Systems (Senior/Lead/Principal)
Salesforce
$149K - $314KSan Francisco, CABig Data Platform & Distributed Systems (Senior/Lead/Principal)
Salesforce
$149K - $314KSan Francisco, CA23d29d
Lead, Big Data Analytics & Engineering
Mastercard
Pune, IndiaLead, Big Data Analytics & Engineering
Mastercard
Pune, India29d
Looking for something different?
Browse all AI jobsFree AI job alerts
Get the latest AI jobs delivered to your inbox every week. Free, no spam.