Senior Data Engineer

We are hiring a Senior Data Engineer to join our Engineering team. In this role, you will take the lead on building and maintaining the metadata ingestion and lineage systems for integrations. You'll collaborate closely with design, product management, and engineering to shape our core platform, improving performance, and influencing our product roadmap. We value your problem-solving skills, technical acumen, and ability to communicate complex ideas. We prioritize your potential, passion for learning, and commitment to best practices that will bring meaningful impact and help shape our platform's future.

Roles and responsibilities

• Build and maintain the services related to data lineage and integrations for our product

• Optimize and troubleshoot existing data infrastructure to ensure reliability and performance

• Work cross functionally with engineers, design, and product

• Design and maintain scalable and efficient data pipelines for processing and analyzing large datasets

• Implement data models and structures to support the organization's data needs.

• Stay up-to-date with industry trends, advancements in data quality tools, and emerging technologies related to data engineering

The ideal candidate should have:

• At least 5 years of industry experience working as a data engineer

• A fundamental understanding of some of the core technologies in our stack

• Experience with big data technologies (e.g., Apache Spark, Hadoop) and data processing frameworks

• Familiarity with database systems, both SQL and NoSQL, and experience with data modeling and database design

• Proficiency in communicating complex technical issues to both technical and non-technical audiences

• Passion for delivering scalable, reliable software

Nice to have

• Building integrations for Modern Data Stack tools, i.e, Snowflake, Looker, dbt

• Building a SQL parser

• Building complex data pipelines

Secoda provides a competitive salary, excellent benefits, and an opportunity to be a part of a growing, dynamic, and innovative environment, employee discounts, wellness programs, and other perks.