Software Engineer, Data Lake

Who we are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.

About the team

The Data Lake team builds and operates Stripe’s Data Lake, enabling high-scale data ingestion, unified storage, and data governance across services for all of Stripe. We operate globally distributed systems at high levels of reliability to support Stripe’s growing scalability, reliability, and product requirements. We enable other teams at Stripe by creating simple abstractions and providing self-service tooling and dashboards to enable users to easily operate services on our infrastructure. We minimize operational toil for the team through regular investment in automation of maintenance operations.

We’re looking for people with a strong background (or interest!) in Data Lake architectures and who are excited about solving challenging distributed systems problems.

What you’ll do

You’ll work with other infrastructure engineers as well as the product engineers who use the systems we build. We’re looking for people interested in data. We’d love to hear from you whether you’re a seasoned software engineer, or whether you’ve just learned you might like working with data lakes .

Responsibilities

• Design, build, and maintain Data Lake infrastructure  – leveraging popular systems such as Hadoop, Spark, Iceberg, Temporal, and Amazon S3 – used by all of Stripe’s engineering teams.
• Work with various stakeholders at Stripe to understand their specific requirements and identify opportunities to better leverage our streaming infrastructure

Who you are

We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement.

Minimum requirements

• 5+ years of professional hands-on software development experience
• Experience designing, building, maintaining and debugging distributed systems
• Experience with scaling distributed systems in a rapidly moving environment
• Experience building infrastructure as a product centered around users’ needs

Preferred qualifications

• Experience with Data Lake architecture
• Experience working with open source technology such Hadoop, Spark, Iceberg or Amazon S3
• Experience with orchestration platforms such as Cadence, Temporal or AWS Step Functions