ETL Specialist
Abu Dhabi, Abu Dhabi, United Arab Emirates
Callsign
Marking a new era in passive authentication, fraud prevention and intelligence. We make digital identity simple and more secure.Russian hacker, Vladimir Leonidovitch Levin, attempted the biggest bank heist the world had ever seen via dial-up internet in 1994, Zia Hayat, Callsign CEO and founder, was hooked - armchair fraud became a real possibility. From this moment, Zia knew he wanted to play a part in stopping the bad guys and securing the internet for all. Founded In 2012, Callsign's mission has been to make Digital Identity simple and secure for everyone and everything. In that time, we've grown to over 200 employees, opened offices in Singapore and Abu Dhabi, been recognised as a WEF Global Innovator and our technology is being used by many of the world's leading financial institutions to keep millions of consumers safe.
But we aren't stopping here. The identity revolution has only just begun, and we are looking to hire the brightest and inquisitive minds to help us make every web, mobile and physical Interaction seamless and secure. If this sounds like you, lets chat.
Responsibilities:
- Develop and maintain ETL pipelines to extract data from multiple production environments, for ingestion into a data warehouse, and transformation into an analytics layer
- Proactively improve processes and documentation around data management, ingestion, versioning, and storage
- Manage internal stakeholders and interface with consumers of the data warehouse, including data science, analytics and governance
- Develop tooling for internal developers who consume the data (data scientists, business analysts, and technical consultants)
- Always keeping security, performance, scalability and cost in mind when designing solutions or working on existing ones
- Develop, maintain and assist with release of microservices related to data extraction
Requirements
- Strong experience with multiple database technologies, including SQL and NoSQL
- 3+ years of collaborative development experience with Python, including CI/CD, version control
- Experience developing scalable ETL pipelines that can handle large volumes and throughput of data
- Experience with data warehousing, management and governance
- Experience with distributed computing frameworks (Spark, Hadoop or similar)
- Cloud development (especially the AWS ETL stack: Glue, Athena, S3)
About you:
- Comfortable working in a fast-paced, multi-tasking, evolving environment
- You strive for technical excellence, collaboration and continuous improvement
- Able to find and analyse trade-offs and pick practical solutions
- Proactive in communicating with stakeholders about requirements and pain-points, and then translating these to concrete improvements.
Desirable Skills and Experience::
- Cloud-native development (kubernetes/helm or similar), familiarity with microservices
- Experience with streaming frameworks (kafka/flink or similar)
- Infrastructure-as-code experience (terraform/CloudFormation/pulumi or similar)
- MLOps experience
- Static-typed compiled languages like java/scala
Benefits
Competitive
Tags: Athena AWS CI/CD Data management Data Warehousing ETL Flink Hadoop Helm Kafka Kubernetes Microservices MLOps NoSQL Pipelines Python Scala Security Spark SQL Streaming Terraform
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Power BI Developer jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open NLP-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs