Senior Data Engineer
Colombia/Argentina
Blanc Labs
We are seeking a skilled Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, implementing, and maintaining data pipelines and infrastructure to support our organization's data-driven initiatives. You will collaborate closely with cross-functional teams to ensure efficient data flow and implement best practices for data management and governance. The ideal candidate should have a strong background in data engineering, proficiency in relevant technologies, and a passion for leveraging data to drive business insights.
Essential Duties and Responsibilities
- Design, develop, and maintain scalable and robust data pipelines to efficiently collect, process, and store data from various sources.
- Develop and maintain data models and schemas to support analytics and reporting requirements. Ensure data integrity, consistency, and optimization for performance.
- Implement Extract, Transform, Load (ETL) processes to cleanse, transform, and enrich raw data into usable formats for analysis and consumption.
- Integrate data from multiple sources such as databases, APIs, and streaming platforms. Ensure seamless data flow across systems while adhering to data governance and security standards.
- Identify opportunities to optimize data pipelines and processes for improved performance, scalability, and efficiency. Monitor system performance and implement optimizations as needed.
- Develop and implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Communicate effectively with cross-functional teams to gather requirements and provide updates on project status.
- Create and maintain technical documentation including data pipeline workflows, data dictionaries, and system architecture diagrams. Ensure documentation is up-to-date and accessible to relevant stakeholders.
- Stay updated on emerging trends, technologies, and best practices in data engineering and related fields. Continuously enhance skills and knowledge to drive innovation and efficiency in data management.
What You'll Need to Be Successful
- Bachelor’s degree in computer science, Engineering, or related field. Master's degree preferred.
- 8+ years of experience in data engineering or related roles.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with big data technologies such as Hadoop, Spark, or Kafka.
- Strong understanding of SQL and database systems (e.g., MySQL, PostgreSQL).
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and related services (e.g., S3, Redshift, BigQuery).
- Familiarity with data warehousing concepts and tools (e.g., Snowflake, Amazon Redshift).
- Experience with version control systems (e.g., Git) and CI/CD pipelines.
- Strong analytical and problem-solving skills with attention to detail.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team in a fast-paced environment.
- Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Knowledge of machine learning concepts and frameworks (e.g., TensorFlow, PyTorch).
Blanc Labs is an equal opportunity employer and is committed to providing employment in accordance with the Ontario Human Rights Code and the Accessibility for Ontarians with Disabilities Act. Accommodations within reason due to a disability or medical need are available on request for candidates taking part in the recruitment process.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Architecture AWS Azure Big Data BigQuery CI/CD Computer Science Data governance Data management Data pipelines Data quality Data Warehousing Docker Engineering ETL GCP Git Google Cloud Hadoop Java Kafka Kubernetes Machine Learning MySQL Pipelines PostgreSQL Python PyTorch Redshift Scala Security Snowflake Spark SQL Streaming TensorFlow
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs