Senior Data Engineer
REMOTE
Roadie
Roadie is a crowdsourced delivery platform that enables urgent, same-day and local next day delivery of just about anything, anywhere, across the U.S.Roadie, a UPS Company, is a crowdsourced delivery platform. Founded in 2014, Roadie works with consumers, small businesses and enterprises across virtually every industry to enable scheduled, same day and urgent delivery in passenger vehicles across the U.S. With more than 200,000 drivers nationwide, Roadie reaches more than 20,000 zip codes – the largest local same-day delivery network in the nation.
Roadie is seeking a Senior Data Engineer who’s passionate about data and making data-driven decisions to join our growing Data Engineering team. This role will focus on building, maintaining, and scaling our data pipelines/platform and CI/CD processes to support streaming architecture. You will work closely with our business and product owners to create useful, easy-to-consume data for reporting and analytics, as well as have the opportunity to help develop strategy for long term Data Platform architecture. Our data is dynamic across many teams, so a collaborative and communicative spirit is essential to ensuring you’re successful in this role.
What You'll Do
- Build efficient, high quality, integrated and increasingly real-time ETL/ELT pipelines to organize, collect, standardize and integrate data that facilitate more complete, accurate and consistent data for insights and reporting
- Partner with engineering, data science, and business stakeholders to build data insights and help them to achieve their business goals
- Deliver data capabilities and new data products to accelerate investments in data and democratize data across the enterprise
- Provide production support for data tools and data needs across the business
- Research and implement cutting edge solutions to solve challenges related to ETL/ELT, data processing, and analytics
Roadie’s Technology Stack
- Python, Ruby on Rails, Golang
- React/Redux, Objective-C and Swift, Android
- Postgres, Redshift, Redis, Kafka
- AWS
- Docker/Kubernetes
- Prometheus/Thanos/Loki/Grafana
- Github/CircleCI/ArgoCD
- Airflow/Apache Pinot/Trino
- Superset/Redash/Looker
What You Bring
- 4+ Experience building data infrastructure and platforms using streaming frameworks such as Kafka/Kinesis/Flink/Spark Structured Streaming, etc.
- 5+ years of experience using CI/CD tools to build and deploy projects
- 5+ years of experience working with DevOps tools such as Docker, Kubernetes, AKS, Helm, Terraform, etc to own end-to-end deployment of Data Engineering projects
- 5+ years of experience with one or more language/framework such as Python/Scala/Spark/PySpark/Java/Hadoop
- 4+ years experience with scaling production systems, ideally in a start-up environment
- Experience working with workflow management tools such as Airflow/Luigi/Dagster
- Experience with OLAP datastores such as Clickhouse, Apache Pinot, Druid
- Experience with PostgreSQL, as well as MPP databases such as Redshift
- Experience with cloud-based architectures on AWS, GCE, or similar
- Experience working with data systems, data warehouse solutions, and ETL/ELT
- Experience with various data visualization tools such as Redash/Superset/Tableau/Looker/Power BI
- Bachelor's degree in Computer Science or related technical field or equivalent practical experience
Bonus
- Experience working with Databricks/Qubole/Snowflake or similar platforms using Spark/PySpark/Scala
- Application and front end development experience
Why Roadie?
- Competitive compensation packages
- 100% covered health insurance premiums for yourself
- 401k with company match
- Tuition and student loan repayment assistance (that’s right - Roadie will contribute directly to your existing student loans!)
- Flexible work schedule with unlimited PTO
- Monthly 3-day weekends
- Monthly WFH stipend
- Paid sabbatical leave- tenured team members are given time to rest, relax, and explore
- The technology you need to get the job done
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture AWS CI/CD Computer Science Dagster Databricks Data pipelines Data visualization Data warehouse DevOps Docker ELT Engineering ETL Flink GitHub Golang Grafana Hadoop Helm Java Kafka Kinesis Kubernetes Looker MPP OLAP Pipelines PostgreSQL Power BI PySpark Python React Redash Redshift Research Ruby Scala Snowflake Spark Streaming Superset Tableau Terraform
Perks/benefits: 401(k) matching Competitive pay Flex hours Flex vacation Paid sabbatical Startup environment Unlimited paid time off
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open AI Engineer jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs