Professional Data Engineer
Waterloo, Canada
Full Time USD 65K - 140K
KION Group
Wir sind ein führender Anbieter für Gabelstapler und Lagertechnik sowie Automatisierungstechnologien und Softwarelösungen für die Optimierung von Lieferketten.Career Development
Competitive Compensation and Benefits
Pay Transparency
Global Opportunities
Learn More Here: https://www.dematic.com/en-us/about/careers/what-we-offer
Dematic provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
The base pay range for this role is estimated to be $65,000-$140,000 at the time of posting. Final compensation will be determined by various factors such as work location, education, experience, knowledge, and skills.
Tasks and Qualifications:This is What You Will do in This Role:
- Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.
- Design and develop microservices to
- Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
- Implement data integration and data quality processes to ensure the accuracy and reliability of data for analytics and reporting.
- Optimize data storage, processing, and querying performance for large-scale datasets.
- Enable advanced analytics and machine learning capabilities on the data platform.
- Continuously monitor and improve data quality and data governance practices.
- Stay up to date with the latest data engineering trends, technologies, and best practices.
What We are Looking For:
- Bachelor’s degree in computer science, Engineering, or a related field.
- 5+ of proven experience in data engineering, data warehousing, and ETL processes.
- Proficiency in data engineering tools and technologies such as SQL, Python, Spark, Hadoop, Airflow, Apache Kafka and Presto.
- Solid experience with table formats such as Apache Iceberg or Delta Lake.
- Design and development experience with batch and real time streaming infrastructure and workloads.
- Solid experience with data lineage, data quality and data observability.
- Solid experience designing and developing microservices and distributed architecture.
- Hands-on experience with cloud-based data platforms (e.g., AWS, Azure, GCP) preferably GCP and data lakehouse architectures.
- Strong experience with container technologies such as Docker, Kubernetes.
- Strong understanding of data modeling, data architecture, and data governance principles.
- Excellent experience with DataOps principles and test automation.
- Familiarity with data processing and querying using distributed systems and NoSQL databases.
- Ability to optimize and tune data processing and storage for performance and cost-efficiency.
- Excellent problem-solving skills and the ability to work on complex data engineering challenges.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
- Previous experience mentoring and guiding junior data engineers is a plus.
- Relevant certifications in data engineering or cloud technologies are desirable.
Tags: Airflow Architecture AWS Azure Computer Science Data governance DataOps Data pipelines Data quality Data Warehousing Distributed Systems Docker Engineering ETL GCP Hadoop Kafka Kubernetes Machine Learning Microservices NoSQL Pipelines Python Spark SQL Streaming
Perks/benefits: Career development Competitive pay Transparency
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Data Science Manager jobs
- Open Principal Data Engineer jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Power BI Developer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs