Data Engineer
Waterloo / Ottawa / Toronto/ Ontario
Applications have closed
Magnet Forensics
Unlock the truth. Protect the innocent. We provide organizations with innovative tools to investigate cyberattacks and digital crimes.Your RoleThe Data Engineer role will build the data pipelines needed to support the analytics for sales, service, and marketing teams to achieve the corporate revenue and contribution objectives. This individual will use their strong software development and DevOps skills to ensure the pipelines and analytics platform are optimized and efficient. The ability to identify inefficiencies will drive continuous improvements and innovation in our processes and operations.
What You Will Accomplish· Develop and maintain data pipelines from various data source to Azure data lake· Maintain analytics platform uptime and stability of pipelines and integration points· Identify areas of improvement in the data pipelines and provide solutions to optimize· Assist in product/tool discovery and assessment· Assist in process development pertaining to business engagement with analytics platform· Ensure governance is followed within the analytics platform· Maintain design documentation across all components of the platform· Ensure all code developed are maintained in Github· Ensure development follows data ops methodology · Ensure deployment of infrastructure is following Infrastructure as Code best practices· Responsible for PR process on peer and 3rd party code before production deployment· Develop required transformation models in DBT· Support production pipelines and analytics infrastructure· Deploy new domains into Snowflake· Develop and maintain Quick Start deployment guide in Azure, Python, Terraform, DBT, and Snowflake· Maintain and monitor data pipelines proactively to ensure high service availability· Ensure all data is tagged and catalogued in the data lake and data warehouse· Ensure data quality checks are developed in pipelines to ensure high quality data is loaded to Data warehouse
What We Are Looking ForWe’re looking for someone who checks off most, but not all, of the boxes listed in “skills and experiences”. It’s more important to us to find candidates who can display indicators of success through skills they have developed and experiences they have been a part of, than to find folks who have ‘been there, done that”. We want to be part of your development journey, and we’ll learn as much from you as you learn from us.
There are a couple must haves, but we will keep that list short: · 3 - 5 years in both traditional and modern data architecture, ETL and data migration and processing included relational databases, cloud data warehousing· 3+ years of experience of IT platform implementation in a highly technical and analytical role· Proficient experience in data modeling with Kimball methodology· Experience with Infrastructure as Code (Terraform)· Proficient in Python, SQL· Deep knowledge of Azure architecture / services· ETL/ELT experience (Talend, Fivetran, Azure Data Factory, Glue, Lambda, DBT)· Experience with Cloud Data Warehouse technologies (Redshift, Snowflake, BigQuery)· Proficient in CI/CD processes and source control tools such as Github· Experience with JIRA and Confluence a plus
The Most Important ThingWe’re looking for candidates that can provide examples of how they have demonstrated Magnet InteGRITy in their previous experiences:
Greater Good – We think beyond our own interests and strive to improve communities around the world. This demonstrates our passion for making a difference in the world.Respect – We hold ourselves accountable through transparent sharing of information and we have faith in each other’s abilitiesInnovation – We lead the industry in excellence and reliability while keeping the user experience simple and relevant. We are not afraid to push the boundaries to stay ahead of our competitors.Teamwork – We collaborate internally and externally, while caring about each other and listening to our customers.We’re committed to continuous learning and are focused on building a diverse and inclusive workforce. This commitment will be reflected in our hiring processes and embedded in our values and how we treat one another. If you’re interested in this role, but do not meet all of the qualifications listed above, we encourage you to apply anyways. Magnet Forensics is an Equal Opportunity Employer and considers applicants for employment without regard to race, colour, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, provincial, or local law. We are committed to providing an inclusive, accessible recruitment process and work environment. Accommodation is available to all applicants upon request throughout the hiring process. If you require accommodation, please let our talent team know, or you can email aoda@magnetforensics.com.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Azure BigQuery CI/CD DataOps Data pipelines Data quality Data warehouse Data Warehousing DevOps ELT ETL FiveTran GitHub Jira Lambda Pipelines Python RDBMS Redshift Snowflake SQL Talend Terraform
Perks/benefits: Career development Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open AI Engineer jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Data warehouse-related jobs
- Open LLMs-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs