Data Engineer

Remote

Job Description

This job posting has expired and no longer accepting applications.

Born to tackle one of the most critical economic challenges of our time, Gaia Dynamics leverages AI to make global trade effortless.

Founded by Andrew Ng’s AI Fund, and led by Emil Stefanutti (Founder and CEO of ContractRoom) and David Sobie (Founder and CEO of Happy Returns), Gaia is a Reg Tech platform that streamlines cross-border regulation compliance, vastly accelerating the processes that govern the $24-Trillion global trade market.

Key Responsibilities:

Data Pipeline Development: Design, build, and maintain scalable data pipelines to support various AI and machine learning projects.

Data Integration: Integrate data from diverse sources, ensuring data quality, consistency, and availability for analysis.

Data Storage: Develop and manage efficient data storage solutions, including databases and data lakes, to support large-scale data processing.

Collaboration: Work closely with data scientists, AI engineers, and other stakeholders to understand data requirements and ensure seamless data flow.

Optimization: Optimize data processing workflows for performance and cost-efficiency.

Monitoring: Implement monitoring and alerting systems to ensure data pipeline reliability and troubleshoot issues proactively.

Documentation: Maintain comprehensive documentation of data infrastructure, processes, and best practices.

Qualifications:

Bachelors or advanced degree in Computer Science, Data Engineering, or a related field.

Proven experience as a Data Engineer, with a track record of building and managing data pipelines and infrastructure.

Proficiency in programming languages such as Python, Java, or Scala.

Expertise in SQL and experience with relational and non-relational databases.

Experience with data integration tools and ETL frameworks.

Knowledge of cloud platforms (AWS, GCP, Azure) and their data services.

Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.

Attributes:

Problem Solver: Strong analytical and problem-solving skills with attention to detail.

Team Player: Ability to work collaboratively in a cross-functional team environment.

Self-motivated: Driven to achieve excellence with minimal supervision.

Communication Skills: Excellent verbal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Adaptability: Ability to thrive in a fast-paced and dynamic startup environment.