Senior Data Engineer (Remote - US)

DISQO is changing the way that the world’s largest brands, agencies and media companies get to know their customers. DISQO is the customer experience (CX) intelligence platform for understanding every customer experience. Businesses trust DISQO to power better decisions for every customer, touchpoint, and outcome. DISQO’s insights, agile testing and advertising measurement products are powered by millions of consumers on the industry’s largest opt-in consumer data platform.
This is a great opportunity to join a fun, exciting & highly motivated team and upgrade your skills while creating real impact. We use a modern tech stack and cloud infrastructure. We are not only looking for work experience, but rather the willingness to step up to challenges and the ability to learn quickly.
We believe the best software is written and managed by small teams that know how to make the impossible possible. We use agile software development techniques and modern tools to focus our efforts on solving our business goals. We use OKRs to track everything we do. We deliver early and often. We obsess over our code, architecture and infrastructure and we believe that these practices lead to higher quality products.

What you get to do:

• Leverage your software development and data engineering skills to impact our business by taking ownership of key projects requiring coding and data pipelines
• Collaborate with product managers, software engineers and data engineers to design, implement, and deliver successful data solutions.
• Identify, design and implement internal process improvements including re-designing Data/Observability infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Design, build and optimize performant databases, data models, integrations and ETL pipelines in RDBMS and NoSQL environments
• Maintain detailed documentation of your work and changes to support data quality and governance.
• Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to the customers
• Be an engaged participant and advocate of agile/scrum practices to ensure health and process improvements for your team
• Define best practices around making our systems and services measurable and work with our various teams to get those best practices applied
• Collaborate with other Engineering teams to ensure our Jobs are emitting the right metrics
• Collect, aggregate and visualize the collected metrics to provide actionable insight

What you bring to the role:

• 5+ years of experience designing and delivering large scale, 24/7, mission-critical data pipelines and features using modern big data architectures
• 3+ years of Scala
• 3+ years of Python
• 3+ years of Spark
• 2+ years of experience with AWS data ecosystem (Redshift, EMR, Glue, Athena, ...)
• 2+ years of experience with observability systems like New Relic, Prometheus/Grafana
• 2+ years of experience with environment automation using Terraform
• Deep knowledge in various ETL/ELT tools and concepts, data modeling, SQL, query performance optimization
• Experience with building stream processing applications using Kinesis
• Experience with workflow management tools (Airflow, Oozie, Azkaban, Luigi, etc.)
• Comfortable working in Linux environment
• Ability to thrive in an agile, entrepreneurial start-up environment

#LI-SG1 #LI-Remote
Perks & Benefits:
·100% covered Medical/Dental/Vision for employee, 80% for dependents·Equity·Generous PTO policy·Flexible workplace policy·Team Offsites·Life Insurance·FSA·Paid Maternity/Paternity leave·Disability Insurance·Travel Assistance Program·24/7 Counseling Services offered to Employees·Access to personal and professional growth tools - Calm App & LinkedIn Learning
Note: The benefits noted above are for full time US based employees only.
DISQO is an equal opportunity employer. Discovery, innovation, and growth are possible when we open ourselves to new possibilities, perspectives, and approaches. That’s why, at DISQO, we welcome, support, and empower individuals from diverse backgrounds. Exceptional teams are rooted in extraordinary people, each with a unique story and a compelling set of skills. DISQO does not discriminate against employees based on race, color, religion, sex, national origin, gender identity or expression, age, disability, pregnancy (including childbirth, breastfeeding, or related medical condition), genetic information, protected military or veteran status, sexual orientation, or any other characteristic protected by applicable federal, state or local laws.
*Recruiting firms that submit resumes to DISQO without first entering into a written contract will not be entitled to any compensation on candidates referred by that firm.