Data Engineer

Welcome to 10Pearls!  

We believe in harnessing the power of technology for social good through our core values: Innovate, modernize and accelerate.

As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure to support data-driven decision-making processes within the organization. You will work closely with data scientists, analysts, and other stakeholders to ensure that data is efficiently collected, stored, and transformed into actionable insights.

Key Responsibilities:

1. Design, develop, and maintain robust data pipelines for ingesting, processing, and transforming large volumes of data from various sources.
2. Implement data integration solutions to consolidate data from multiple databases, data warehouses, and external APIs.
3. Collaborate with cross-functional teams to understand data requirements, business objectives, and analytical needs.
4. Develop and maintain data models, schemas, and metadata to support data analysis and reporting activities.
5. Perform data cleaning, validation, and quality assurance to ensure accuracy, consistency, and completeness of data.
6. Monitor data pipeline performance, troubleshoot issues, and implement solutions to resolve data-related problems.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field. A Master's degree is a plus.
• Proven experience as a Data Engineer or similar role, with a strong background in data warehousing, ETL processes, and database management systems.
• Proficiency in programming languages such as Python, Java, or Scala for data processing and automation tasks.
• Hands-on experience with Big Data technologies like Hadoop, Spark, Kafka, and related ecosystem tools.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud for deploying and managing data infrastructure.
• Knowledge of SQL, NoSQL, and data modeling techniques for designing efficient and scalable databases.

Preferred Skills:

• Experience with containerization technologies such as Docker and container orchestration platforms like Kubernetes.
• Knowledge of machine learning concepts and frameworks for building predictive analytics solutions.
• Certification in relevant technologies such as AWS Certified Big Data Specialty, Google Professional Data Engineer, or equivalent certifications.

We thank you for applying to this job position, we’re more than thrilled to start reviewing your profile and great skills! This is the first step in our selection process, so you will be hearing back from our awesome recruitment team regarding the next steps 😀 

10Pearls Team