Senior Data Engineer

Description

As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with a diverse range of users, including business users, leadership, mechanical engineers, controls programmers, biologists, and data scientists. Your expertise in Azure, Fabric, Data Factory, IoT, and common data formats such as Parquet and JSON will be crucial in optimizing our data processes and driving insightful business decisions through Power BI. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. This Data Engineer's skills also include familiarity with several programming languages and knowledge of learning machine methods.

Key Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory / Fabric.
• Implement data storage solutions using Azure SQL Database, Azure Data Lake, and other Azure services.
• Develop and maintain ETL processes to ensure data is accurately and efficiently processed.
• Collaborate with data analysts and business stakeholders to understand data requirements and deliver appropriate solutions.
• Build and maintain data models and data warehouses to support business intelligence and reporting needs.
• Develop and maintain data integration solutions using Azure Data Factory and other relevant tools.
• Create and optimize complex SQL queries to retrieve and manipulate data.
• Implement and manage data security and compliance measures.
• Create and maintain documentation related to data architecture, processes, and workflows.
• Utilize Power BI and Power Query to create interactive and insightful reports and dashboards for business users.
• Work with cutting-edge technologies like Fabric and IoT to drive innovation in data solutions.
• Engage with a wide range of users, including business users, leadership, mechanical engineers, controls programmers, biologists, and data scientists, to understand their data needs and provide tailored solutions.
• Handle data in various formats, including Parquet, JSON, and other common formats.
• Monitor and optimize costs associated with data storage and processing, ensuring efficient use of resources.
• Monitor and troubleshoot data issues, ensuring high availability, reliability and performance of data systems.
• Working knowledge of Python and Jupyter Notebooks or similar tools a plus.
• Knowledge of Azure Purview and data security best practices a plus.
   

Requirements

• Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field.
• 5+ years of experience as a Data Engineer or in a similar role.
• Strong proficiency in Azure services, including Azure Data Factory, Pipelines, Azure SQL Database, Azure Data Lake, and other Azure data services.
• Experience with ETL tools and processes.
• Strong SQL skills and experience with relational databases; knowledge of big-data modeling concepts such as Star / Snowflake Schemas. 
• Proficiency in Power BI and Power Query for data visualization and reporting.
• Knowledge of data warehousing concepts and best practices; understanding of data ops principles for transformation/curation of data (raw, structured, and semantic transformation layers).
• Knowledge of data formats such as Parquet, JSON, and other common formats.
• Familiarity with IoT platforms and data integration from various IoT devices.
• Experience with cost monitoring and optimization in a cloud environment.
• Detail-oriented with a high level of accuracy in work.

Working Conditions

Must be able to work in both industrial environments and office settings. This involves adhering to safety protocols, wearing appropriate protective gear, and sometimes working with industrial machinery or in environments with strict access controls.

Please Note: To 3rd Party Search Firms/Employment Agencies: All inquiries must be directed to careers@targan.com. Please do not call or email any TARGAN employee about current or future job openings. All resumes submitted by search firms or employment agencies to any employee at TARGAN via email, telephone, social media, or other means will be deemed to be the sole property of TARGAN unless the firm submitting the resume has previously entered into a written agreement with TARGAN regarding recruitment services and has been approved by Human Resources to work on an open position. TARGAN will not pay any fee or remuneration concerning candidates without complying with this requirement.