Data Ops Engineer
London, England, United Kingdom
LMAX Group
LMAX Group is a global financial technology company, which operates a leading institutional exchange for FX and delivers transparent, fair, precise and consistent execution a level playing field to all market participants.Background
LMAX Group is a FinTech company that designs, develops, builds and runs leading edge financial exchanges in major financial centres around the world, specialising in fiat and crypto-currencies.
Our Data Operations team is responsible for the handling and storage of the company’s data, supporting our business intelligence and data analytics platforms. They bridge the gap between Data Scientists, Software Engineers, and Infrastructure Engineers.
We're looking for an energetic engineer to join a very small team managing a platform of increasing business importance. We are given a considerable amount of autonomy in designing LMAX’s data analytics platform, and choosing the technologies that go into it. We’re expected to have a lightning fast time to market and do intra-day deployments – our platform is used constantly to inform business decisions.
This should describe you
- A flexible, interdisciplinary engineer, continuously learning and testing new technologies.
- You're comfortable in a fast paced and agile development environment, and highly value CI/CD methodologies and practices.
You will have these key skills
- Coding and scripting experience (Bash, Python, Java, Go)
- Worked with Infrastructure-as-Code practices and tooling, and in a DevOps culture (Puppet, Ansible, Terraform, GitLab CI)
- Familiar with "higher level" DevOps tooling & containers (Docker, Nomad, Terraform, Kubernetes)
- Experience with different types of databases; relational (MySQL) and time series (InfluxDB, QuestDB)
Requirements
You will bring some of these skills, but more importantly you're interested in some of the others
- Familiar with Data Analytics tooling and concepts (ETL/ELT, Metabase, Jupyter, Superset)
- Familiar with the concepts of data modelling, data warehousing, data lakes
- Data-driven monitoring and observability (Grafana, InfluxDB, Splunk, Prometheus, etc)
- Familiar with Cloud technology (AWS)
- DBA experience / database query tuning
- Supporting CI/CD delivery pipelines (GitLab, Jenkins, etc)
- Linux skills – building, configuring, monitoring, automating (CentOS, Fedora)
What you and the team will be doing
- Support our data repositories, pipelines, tooling, and presentation layers.
- Work with Systems Engineers to maintain our data analytics platform.
- Work with Data Scientists and Software engineers to research or develop the tools necessary to process our data.
- Design and build infrastructure for data storage and processing.
- Proactive monitoring of systems and ingestion pipelines, identifying and addressing bottlenecks.
- Automate software deployments and upgrades.
- Troubleshooting and tuning database read / write workloads.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Ansible AWS Business Intelligence CI/CD Crypto Data Analytics DataOps Data Warehousing DevOps Docker ELT ETL FinTech GitLab Grafana InfluxDB Java Jupyter Kubernetes Linux Metabase MySQL Pipelines Python Research Splunk Superset Terraform Testing
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Data Manager jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Junior Data Scientist jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Data Analyst Intern jobs
- Open Junior Data Engineer jobs
- Open Research Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open PhD-related jobs
- Open NLP-related jobs
- Open CI/CD-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs