Data Engineer, Sr. Supervisor
Giza, Giza Governorate, Egypt
Orange Egypt
اورنچ بتوفر لك خدمات وعروض خاصة ورائعة. استمتع بعروض الانترنت المنزلي، باقات الموبايل، موبايلات، وحلول البيزنس. اكتشف المزيد واشترك الآن مع أسرع شبكة فى مصر.Purpose of the job
Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the Data Warehouse, including all DWH stakes, DWH model, CLDM layer and PL layer. Assures the data management, integration & quality standards, and processes of the data engineering workflow are all met.
Duties and responsibilities
- Analyze new business integration needs, fully understand the requirements and perform the required technical analysis to accommodate the new requirements.
- Perform the required development for DWH model to achieve the targeted business needs which include model structure updates, ETL/ELT job load, PL layer jobs modification.
- Implement the right controls to maintain the DWH quality as per the standard Specs and continuously update these quality control checks.
- Work closely with DWH BI analyst to ensure correct and consistent mapping criteria between sources and DWH databases.
- Coordinate with data operations and administrators (system and database) to ensure the best performance monitoring and tuning.
- Optimize data integration platform to provide optimal performance under increasing data volumes.
- Build data pipelines,Analyze and organize data,Build data ingestion scripts/workflows, and Perform quality checks on data
- Drive integration projects from idea formulation, through design and implementation collaborating with partner teams.
- Participate in vendors technical requirements, gap analysis and RFPs
- Support technical decision making in the area of Big Data eco-system and data platform architecture and relevant migration use cases
- Collaborate with data scientists, BI analysts, modelers and IT team members on project goals.
- Monitor and optimize the performance of data platform systems and computing infrastructure.
Job Specifications:
Education
- Bachelor degree of Engineering in Computer Systems, or Computer Science.
Experience
- 5-8 years of hands-on Data engineering, ETL development, and Data Modeling experience
- Solid experience with IBM datastage and Teradata DWH tools/Models is a plus.
- At least 3 years of experience of, managing, designing, programming, administering, and tuning complex conversions moving data from multiple disparate Source Databases into separate/different Data Models
- Extensive experience using and tuning SQL
- Project management experience is a plus
- Expereince working in a big data/ Datalake environment and using big data tools ( NiFi, Airflow, spark, Hive, Kafka, etc )
- Experience with data infrastructure as a code, automation and DevOps practices.
- Excellent understanding of systems design patterns
- Past experience in telecom operators and service providers is preferred.
Skills and abilities
- Very good English both written & spoken.
- Excellent collaboration and communication skills and comfortable working across multiple teams.
- Strong hands-on skill, can drill deep into complex systems design and implementation.
- Strong problem solving and troubleshooting skills.
- Excellent knowledge of IBM DataStage and BI solutions
- Excellent programming and debugging skills.
- Excellent systems administration skills.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture Big Data Computer Science Data management DataOps Data pipelines Data quality Data warehouse DevOps ELT Engineering ETL Kafka NiFi Pipelines Spark SQL Teradata
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Engineer II jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Research Scientist jobs
- Open Business Intelligence Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Business Data Analyst jobs
- Open Principal Data Scientist jobs
- Open Sr Data Engineer jobs
- Open Data Science Manager jobs
- Open Data Science Intern jobs
- Open Lead Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Junior Data Scientist jobs
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst II jobs
- Open Software Engineer, Machine Learning jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Engineer III jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Snowflake-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs
- Open RDBMS-related jobs