Lead Data Engineer

About BMLL:

We are the leading independent provider of harmonised Level 3 historical data and analytics to the world’s most sophisticated capital market participants. BMLL offers banks, brokers, asset managers, hedge funds and global exchange groups immediate and flexible access to the most granular Level 3, T+1 order book data and advanced analytics, enabling them to accelerate research, optimise trading strategies and generate alpha at unparalleled speed and scale.

We have a fantastic team and our culture is inclusive and highly collaborative - a place where our employees are encouraged to be themselves.

We give all our employees share options, empowering them to get involved in decision making and help shape the future of our company as we continue to grow and scale.

We offer a combination of remote and office (London based) working, weekly team lunches and plenty of office snacks!

For more information, please visit our website, www.bmlltech.com or visit our Twitter, @bmlltech or LinkedIn, @BMLL.

About the Role:

The Technology group in BMLL solve complex problems. We’re an agile, dynamic group where new ideas are encouraged and explored. Whilst we heavily use Python and AWS, we never shy away from assessing and leveraging new technical tools if the need arises. Our current technical stack and tools includes AWS ECS, EMR (Big Data), Postgres & Lambda, Apache Airflow, Python, C++, Playwright, Jenkins, Docker, NodeJS, Git, Jupyter notebook, Jira and Splunk for monitoring. We are short on bureaucracy and high on delivery.

We are looking for a Lead Data Engineer to join our Data Engineering Team, reporting to the Compute Environment Lead. You will build complex data pipelines in order to compute a variety of advanced analytics and metrics across our universe of exchange order book data. You will utilise AWS Cloud Technology and Python toolsets to develop these pipelines for new and existing data content at scale and work with the Product team in a truly agile customer centric environment.

What makes this job special:

• The team is a mixture of data engineering and data science individuals. All your work will have a direct impact on the business, as we work closely with our product team.
• You will be part of a team that works on a petabyte scale data lake and an award-winning data science environment to analyse the data.
• You will come in at a time where you will help us shape technology in the firm.

As the Lead Data Engineer, you will:

• Lead a small team of Data Engineers, providing technical direction.
• Be the SME on Data Engineering across the BMLL Technology group.
• Utilise AWS Cloud Technology and Python toolsets to develop complex data pipelines.
• Deliver software within our Agile Development Model.
• Work closely with the Exchange Data Team, Compute Environment Team and The Product Team to support our customers and improve our Data Science product.
• Help with technical initiatives such as but not limited to Technical Prototyping, Data Quality, Performance Tuning, New Product Features and Technical Roadmap delivery.
• Support our Operations team as the Subject Matter Expert for the Data Pipelines.

Requirements

Essential

• 5-8 Years working in a Data Engineering role.
• Experience of Cloud Technology preferably AWS.
• Experience of working with Data at scale.
• Experience in designing Data Engineering Solutions.
• Experience of Python for the purposes of Data Engineering.
• Willingness to work in a fast paced environment, with tight deadlines.
• Excellent teamwork and ability to work in a multidisciplinary team.
• Experience of PostgresSQL(or any relational database).

Desirable

• Experience working in Finance.
• Basic understanding of financial markets.
• Experience of working in an Agile Fail Fast Environment.
• Experience of Spark, Jenkins, Docker, RestAPIs, Apache Airflow, NoSQL.
• Experience of Data Concepts such Data Models, Schemas, CDO, Data Quality
• Familiarity with data science tools (Jupyter, Pandas, Plotly)
• Familiarity working with an Agile Development Model.

Benefits

• Competitive salary
• 25 days holiday plus bank holidays
• Share Options after completion of probationary period
• Pension Scheme
• Combination of remote and London based office working
• A Wellbeing Physical Activity budget
• Continuous learning through training and challenging projects
• Collaborative culture
• Life insurance
• Weekly team lunches
• Free fruit, snacks and drinks provided throughout the day (when office based)
• Fridge fully stocked with beer and wine (when office based)
• Regular Team Socials
• Cycle to Work Scheme

We are an inclusive employer and welcome applicants from all backgrounds. We pride ourselves on our commitment to Equality and Diversity and are committed to removing barriers throughout our hiring process - if you have any special requirements or require reasonable adjustments to help you access career opportunities at BMLL, please do let us know careers@bmlltech.com