Principal Data Engineer
Remote - Brazil (LATAM)
Applications have closed
Outrider
Autonomous yard operations have set a new standard. Yard automation transforms yard operations into an efficient, safe, and sustainable solution.
The companyOutrider is a software company that is automating distribution yards with electric, self-driving trucks. Our system eliminates manual tasks that are hazardous and repetitive while it improves safety and efficiency. Outrider’s mission is to drive the rapid adoption of sustainable freight transportation. We are a private company founded in 2018 and backed by NEA, 8VC, Koch Disruptive Technologies, and other top-tier investors. Our customers are Fortune 200 companies and our autonomous trucks are already running in distribution yards. For more information, visit www.outrider.ai
The roleThe Principal Data Engineer will be responsible for the design, implementation and continuous improvement of the data pipeline that brings product performance data to the Engineering, Test Engineering, and Business teams quickly and accurately. Data flows from trucks testing at Outrider's test site and customer sites.
This position plays an essential role in helping deliver a safety-critical system for industrial automation. The opportunity offers a very talented, self-starting engineer the chance to help develop a market-defining enterprise product that combines autonomous vehicle technology with a software-as-a-service (SaaS) business model.
The ideal candidate will embrace our goal to drive zero-emission, self-driving vehicle adoption, and help us realize our potential to define, build, and lead a new, category of robotic automation for the enterprise.
To protect yourself against the increasing number of recruiting scams, please make sure that you are communicating with Outrider Technologies, Inc. or one of its employees. The only way to communicate with us is through our corporate website at www.outrider.ai, through corporate emails utilizing our domain name of @outrider.ai, and through our job board at jobs.lever.co/outrider. Be vigilant when checking domains because imitators often make very small changes to trick the eye. Additionally, please know that Outrider does not use text messaging or public messaging platforms, such as Telegram or Whatsapp, to communicate with candidates and Outrider will never ask an employment candidate for financial information or for payment of any kind.
The roleThe Principal Data Engineer will be responsible for the design, implementation and continuous improvement of the data pipeline that brings product performance data to the Engineering, Test Engineering, and Business teams quickly and accurately. Data flows from trucks testing at Outrider's test site and customer sites.
This position plays an essential role in helping deliver a safety-critical system for industrial automation. The opportunity offers a very talented, self-starting engineer the chance to help develop a market-defining enterprise product that combines autonomous vehicle technology with a software-as-a-service (SaaS) business model.
The ideal candidate will embrace our goal to drive zero-emission, self-driving vehicle adoption, and help us realize our potential to define, build, and lead a new, category of robotic automation for the enterprise.
Duties and responsibilities
- Design, implement, and improve all aspects of the data pipeline, from ingestion through analysis to visualization, to bring the right data to the right internal customers.
- Work cross-functionally with other teams at Outrider to ensure the data pipeline (including on the cloud) serves the various internal and external customers of Outrider data.
- Drive and advise the Engineering teams on how to approach data engineering and analytics, and be an advocate for data-driven decision making at all levels of Outrider by providing data tools that are clean and reliable.
- Work with the team to understand and prioritize development and sustainment projects and drive toward a product that meets all customer, business, and technical expectations.
- Collaborate and mentor other data engineering team members and participate in peer design and code reviews.
Required qualifications
- Demonstrated experience creating automated, reproducible data pipelines and working with complex, large data sets
- 8+ years working in Data Engineering
- 1 or more years experience working with and integrating AWS tools such as Lambda, Athena, API Gateway, Batch, Glue, and RDS
- Experience with Spark/PySpark and other big data tools
- Experience creating cloud-based ETL workflows
- Experience with infrastructure-as-code platforms
- Proficient with at least one general-purpose programming language, such as Python or Scala
- Comfortable working with APIs to access data from a variety of sources
- Experience with the software development life cycle, modern software/hardware/system testing methods, and continuous integration
- Self-motivated and able to identify and fix issues before they become blockers
- Excellent written and verbal communication skills
- Strong analytical, curious mindset
Ideal qualifications
- Experience architecting server-less systems
- Experience with Docker
- Experience with Apache Arrow
- Experience with robotics, autonomous trucks or other automated distribution yard products
- Experience in ROS and ROS bag format
- Experience with C++ and Python
Compensation & benefits
- Salary range of $150,000 - 200,000. For benefits, check this out!
To protect yourself against the increasing number of recruiting scams, please make sure that you are communicating with Outrider Technologies, Inc. or one of its employees. The only way to communicate with us is through our corporate website at www.outrider.ai, through corporate emails utilizing our domain name of @outrider.ai, and through our job board at jobs.lever.co/outrider. Be vigilant when checking domains because imitators often make very small changes to trick the eye. Additionally, please know that Outrider does not use text messaging or public messaging platforms, such as Telegram or Whatsapp, to communicate with candidates and Outrider will never ask an employment candidate for financial information or for payment of any kind.
Tags: APIs Arrow Athena AWS Big Data Data pipelines Docker Engineering ETL Industrial Lambda Pipelines PySpark Python Robotics Scala SDLC Spark Testing
Regions:
Remote/Anywhere
North America
South America
Country:
Brazil
Job stats:
16
0
0
Category:
Engineering Jobs
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Manager jobs
- Open Data Quality Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs