Data Engineer (Remote)
San Francisco
Applications have closed
AllTrails
Search over 400,000 trails with trail info, maps, detailed reviews, and photos curated by millions of hikers, campers, and nature lovers like you.AllTrails is the most trusted and used outdoors platform in the world. We help people explore the outdoors with hand-curated trail maps along with photos, reviews, and user recordings crowdsourced from our community of millions of registered hikers, mountain bikers, and trail runners in 150 countries. AllTrails is frequently ranked as a top-5 Health and Fitness app and has been downloaded by over 40 million people worldwide.
Every day, we solve incredibly hard problems so that we can get more people outside having healthy, authentic experiences and a deeper appreciation of the outdoors. Join us!
What You’ll Be Doing:
- Work cross-functionally to ensure the company has access to clean, reliable, and secure data required to make informed business decisions and provide the backbone for new product features
- Build, deploy, and orchestrate large-scale batch and stream data pipelines to transform and move data to/from our data warehouse and third-party systems
- Deliver scalable, testable, maintainable, and high-quality code
- Investigate, test-for, monitor, and alert on inconsistencies in our data, data systems, or processing costs
- Create tools to improve data discoverability and documentation
- Ensure data collection and storage adheres to GDPR and other privacy and legal compliance requirements
- Uphold best data-quality standards and practices, promoting such knowledge throughout the organization
- Work closely with a small tight-knit data team consisting of data analysts and scientists, providing the team with engineering expertise
Requirements:
- 3+ years of experience in a Data Engineering role
- Experience with one or more high-level non-SQL-based data processing languages (e.g. Python, Java, Ruby)
- Proficiency with SQL and experience working with high volume datasets in SQL-based warehouses such as BigQuery, Redshift, Snowflake, or others
- Deep understanding of data modeling, access, storage, caching, replication, and optimization techniques
- Ability to orchestrate data pipelines through tools such as Apache Airflow
- Experienced in container orchestration (e.g. Docker)
- Understanding of the software development lifecycle and CI/CD
- Monitoring and metrics-gathering (Datadog, NewRelic, Cloudwatch, etc)
- Proficiency with git
- Excellent documentation skills
- Self-motivation and a deep sense of pride in your work
- Passion for the outdoors
- Comfort with ambiguity, and an instinct for moving quickly
- Humility, empathy and open-mindedness - no egos
Bonus Points:
- Experience with parallelized data processing frameworks such as Apache Beam, Apache Spark, Google Dataflow, AWS Glue, etc
- Infrastructure-as-code, such as Terraform and basic dev-op principles
- Moving data within a Multi-Cloud architecture (AWS and Google)
- Experience with ELT tools such as Fivetran, dbt or Dataform
- Experience with feature collection for ML systems
- Software development experience with Ruby on Rails
Our Commitment to You:
- A competitive and equitable compensation plan. This is a full-time, salaried position that includes equity
- Physical & mental well-being including health, dental and vision benefits + a monthly stipend for wellness expenses
- Trail Days: First Friday of each month off to hit the trails!
- Unlimited PTO
- Flexible parental leave
- Remote employee equipment stipend to create a great remote work environment
- Annual continuing education stipend
- Discounts on subscription and merchandise for you and your friends & family
- An authentic investment in you as a human being and your career as a professional
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow AWS BigQuery CI/CD Dataflow Data pipelines Docker ELT Engineering FiveTran Git Machine Learning Pipelines Python Redshift Ruby Snowflake Spark SQL Terraform
Perks/benefits: Career development Competitive pay Equity Fitness / gym Flex hours Flex vacation Health care Home office stipend Parental leave Salary bonus Unlimited paid time off Wellness
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs