Sr. Data Engineer
Remote, US
Applications have closed
Anaconda
Accelerate growth efficiently for everyone with the AI and data science experts.Role: Sr. Data Engineer
Reports to: Director, Infrastructure
Department: IT
Location: Remote, US
Job Type: Full Time, Exempt
Help us Shape the Future of Data
Anaconda is the world’s most popular data science platform. With more than 26 million users, the open-source Anaconda Distribution is the easiest way to do data science and machine learning. We pioneered the use of Python for data science, championed its vibrant community, and continue to steward open-source projects that make tomorrow’s innovations possible. Our enterprise-grade solutions enable corporate, research, and academic institutions around the world to harness the power of open source for competitive advantage and groundbreaking research.
Anaconda is seeking people who want to play a role in shaping the future of enterprise machine learning, and data science. Candidates should be knowledgeable and capable, but always eager to learn more and to teach others. Overall, we strive to create a culture of ability and humility and an environment that is both relaxed and focused. We stress empathy and collaboration with our customers, open-source users, and each other.
Here is what people love most about working here: We’re not just a company, we’re part of a movement. Our dedicated employees and user community are democratizing data science and creating and promoting open-source technologies for a better world, and our commercial offerings make it possible for enterprise users to leverage the most innovative output from open source in a secure, governed way.
Summary
Anaconda is seeking a talented Data Engineer to join our rapidly-growing company. This is an excellent opportunity for you to leverage your experience and skills and apply it to the world of data science and machine learning.
What You’ll Do:
- Support Anaconda’s legacy data infrastructure and drive the evolution of our pipelines.
- Identify and implement process improvements: designing infrastructure that scales, automating manual processes, etc.
- Drive database design and the underlying information architecture, transformation logic, and efficient query development to support our growing data needs.
- Implement testing and observability across the data infrastructure to ensure data quality from raw sources to downstream models.
- Write documentation that supports code maintainability.
- Take ownership of the various tasks that will allow us to maintain high-quality data; ingestion, validation, transformation, enrichment, mapping, storage, etc
- Work closely with Product teams to anticipate and support changes to the data.
- Work with the Business Insights team and Infrastructure teams to build reliable, scalable tooling for analysis and experimentation.
- Have a high sense of urgency to deliver projects as well as troubleshoot and fix data queries/ issues.
What You Need:
- 5+ years of relevant experience inside the engineering domain.
- Database experience with relational and non-relational data stores, including Big Query.
- Deep experience in ETL/ELT design and implementation using tools like Apache Airflow, Prefect, Matillion, Fivetran, Stitch, Kinesis, Lambda, Glue, Athena, etc.
- Experience working with large data sets, and an understanding of how to write code that leverages the parallel capabilities of Python and database platforms.
- Strong knowledge of database performance concepts like indices, segmentation, projections, and partitions.
- To be self-directed/motivated with excellent organizational skills.
- Proficiency in Python.
- Experience executing projects with Data Science and Engineering teams from start to finish.
- To be comfortable with varying degrees of ambiguity. As a rapidly growing startup, our requirements and priorities evolve quickly!
- Experience with cloud infrastructure, containerization, and orchestration.
- A team attitude: “I am not done until WE are done”.
- To embody our core values:
- Ability & Humility
- Innovation & Action
- Empathy & Connection
- To care deeply about fostering an environment where people of all backgrounds and experiences can flourish.
What Will Make You Stand Out:
- Experience working in a fast-paced startup environment.
- Experience working in an open-source or data science-oriented company.
- Experience with Kafka or other event streaming technologies.
- Experience with Dask and Prefect.
- Experience with infrastructure as code (Terraform, Cloud Formation or Ansible).
Why You’ll Like Working Here:
- Unique opportunity to translate strong open source adoption and user enthusiasm into commercial product growth
- Dynamic company that rewards high performers
- On the cutting edge of enterprise application of data science, machine learning and AI
- Collaborative team environment that values multiple perspectives and clear thinking
- Employees-first culture
- Flexible working hours
- Medical, Dental, Vision, HSA, Life and 401K
- Health and Remote working reimbursement
- Paid parental leave - both mothers and fathers
- Pre-IPO stock options
- Open vacation policy and monthly company days off known as Snake Days
- 100% remote and flexible working policy – we embrace this fully through how we operate as a company.
An Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Anaconda Ansible Architecture Athena BigQuery Data quality ELT Engineering ETL FiveTran Kafka Kinesis Lambda Machine Learning Matillion Open Source Pipelines Python Research Streaming Terraform Testing
Perks/benefits: Career development Equity Flex hours Flex vacation Health care Medical leave Parental leave Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Senior Data Architect jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Manager jobs
- Open Data Quality Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs