Data Engineer
Centurion, South Africa
Applications have closed
OUTsurance
Innovative, value-for-money insurance products, backed by awesome service and 10% of your paid insurance premiums back in cash after three consecutive claim-free years.Company Description
OUTsurance has been propelling the South African insurance industry forward for the last 25 years. As leaders in the field, we’re always looking for innovative ways to create digitally-advanced solutions, without losing sight of our human values.
Our continued success can be attributed to OUTstanding employees who set the bar high with their energy and expertise. If you’re keen to grow your career in a vibrant environment with lots of friendly ‘gees’, this could be the career opportunity you’ve been looking for.
Job Description
Do you live and breathe all things data related?
We are looking for a data engineer to join our growing team of data experts. Are you passionate about the technical aspects of data management? See it as a challenge to build data pipelines that are optimised to run as quick as possible, delivering quality data sets that can be reused by multiple teams. As a data engineer within our team, you will be responsible for developing best practices and patterns, maintain current workloads, optimize our data warehouse builds, data pipelines, and data products. The data engineer will support multiple stakeholders and analytical teams.
Your Duties and responsibilities
- Design, build and maintain scalable and reliable data pipelines to process large volumes of data from various sources.
- Develop and maintain data models, databases, and data warehouses to support the analytic teams reporting needs.
- Ensure data quality and accuracy by implementing data validation and monitoring processes.
- Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide solutions to support their work.
- Excellent written and verbal communication skills; with the ability to explain complex problems in a simple and effective manner.
Team Responsibilities
- To design and build highly available, scalable, and fault-tolerant data infrastructure to support data processing.
- Develop and maintain infrastructure automation tools, deployment pipelines, and monitoring systems.
- Core to this is the team’s collaboration with other engineers, data scientists, and analysts to ensure the availability and performance of the data infrastructure.
- We evaluate new data technologies and tools that enhances the performance and reliability of the data infrastructure and drive adoption of these technologies within the bigger data community.
Competencies
- Ability to apply industry best practices
- Ability to give input into innovative solutions
- Ability to work under pressure and tight deadlines
- Self-motivated and a self-starter
- Ability to work in a team environment
Qualifications
Qualification and Experience
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering or related fields.
- Proficiency in at least one programming language (Python, C#, etc.) and SQL.
- Proven experience with data modelling, ETL processes, and data warehousing.
- Experience with cloud platforms such as AWS, GCP, or Azure
- Understanding of data processing technologies and data management principles
- Familiarity with data technologies such as Synapse, Databricks, DeltaLake, and AirFlow
- Familiarity with infrastructure automation tools such as Ansible, Terraform, or CloudFormation
Additional Information
In accordance with OUTsurance Insurance Company Ltd Employment Equity goals, preference will be given to individuals who meet the job requirements and are from the various designated groups.
An ideal candidate will be able to align their personal work values to the OUTsurance values of Awesome Service, Passionate, Honest, Human, Dynamic and Recognition. Enthusiastic in dealing with challenges in a stressful, deadline orientated environment is essential.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Ansible AWS Azure CloudFormation Computer Science Databricks Data management Data pipelines Data quality Data warehouse Data Warehousing Engineering ETL GCP Pipelines Python SQL Terraform
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Analyst Intern jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open LLMs-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs
- Open Hadoop-related jobs