Data Engineering Lead Developer
Singapore
Applications have closed
BitMEX
Welcome to BitMEX, Most Advanced Crypto Trading Platform for Bitcoin. Home to the Perpetual Swap, industry leading security, up to 100x leverage and a 100% verified customer base.BitMEX is the world’s leading cryptocurrency derivatives trading platform, which has pioneered cryptocurrency trading through relentless commitment to change, and continues to set benchmarks for innovation, liquidity, and security today.
As the world's most advanced peer-to-peer crypto-products trading platform and API, BitMEX gives knowledge, confidence, and precision to hundreds of thousands of traders, transacting billions of USD a day.
Role Overview
Overseeing the full life-cycle and back-end development of the brokerage business’ data warehouse. This role will be responsible for developing ETL processes and pipelines, on-boarding new system feeds, administering our KDB time-series database, managing downstream data feeds and ensuring a fault tolerant data architecture.
The data engineering teams will work closely with data analysts, the electronic trading technology team, and product management in order to ensure data is available so teams across the organization are able to generate analytics and insights to make informed management decisions.
Responsibilities
- Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
- Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
Qualifications
- Degree holder of a Computer Science, Statistics, Informatics, Information Systems or another quantitative discipline.
- Familiar with OOP programming languages such as Java or Python.
- 2+ years experience managing KDB systems.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Following TDD/BDD methodologies and clean coding practices.
- Experience working in a Linux environment.
- Comfortable working with developer tools such as GIT, Jira and Confluence.
- Familiar with automated build, test and deployment pipelines (e.g. GitLab or Jenkins).
- Strong problem-solving skills and a confident communicator.
- Ability to work independently and comfortably to tight schedules.
Join us, as we build a thriving cryptocurrency ecosystem through strategic investments in emerging cryptocurrency technology, and create the future of digital financial services.
Tags: Airflow APIs Azkaban Business Intelligence Computer Science Crypto Data analysis Data pipelines Engineering ETL Git GitLab Jira Linux OOP Pipelines Python Security Statistics TDD
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open AI Engineer jobs
- Open Senior Data Architect jobs
- Open Power BI Developer jobs
- Open Data Analytics Engineer jobs
- Open Manager, Data Engineering jobs
- Open Senior Business Intelligence Analyst jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data warehouse-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs