Big Data Engineer
Saint Julian's, Saint Julian's, Malta - Remote
Applications have closed
Gaming Innovation Group
Trust GiGs award-winning iGaming Platform and Sportsbook solution to digitally transform your business in a multitude of regulated marketsThe Role
As part of the Big Data Team, you will be using cutting edge technologies to work on collating data across different sources within GiG. Sources are all in real time, and you will be supporting an event driven micro service lambda architecture.Your focus is to work with the current agile team and contribute to the platform’s objectives and continue being an enabler to many other data technology stakeholders such as the Business Intelligence, Data Science and Quality Assurance teams. You will be up for a challenge, to continue maintaining and adding new features to a platform that ingests up to 5000 messages per second across multiple products such as Lottery, Sports and Casino.
Reporting to the Lead Big Data Engineer and supported by the Big Data Architect to follow best practices, you’ll be guided into delivering world class product increments that support our Tier 1 Platform.
You’re really awesome at:- Object oriented programming (Java)
- Data modelling using any database technologies
- ELT processes (ETLs are oldschool, we transfer in memory now) and experience with Apache Spark or Apache NiFi
- Applied understanding of CI\CD in change management
- Dockerised applications
- Used distributed version control systems
- Excellent team player
- Meticulous and passionate about your work
- Functional oriented programming (experience with Python, Scala)
- Analytical mindset
- Low latency databases such as ClickHouse
- Hold a Bachelor’s Degree in Computer Science or equivalent
- Can collaborate in scoping exercises
- Mentoring skills
- Have worked with both Linux and Windows environments.
- Unix/Linux
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Big Data Business Intelligence Computer Science ELT Lambda Linux Python Scala Spark
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Junior Data Engineer jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs