Data Engineer

Data Engineer

Department: Engineering

Employment Type: Full Time

Location: London, UK

Compensation: £70,000 - £85,000 / year

Description

We are seeking a skilled mid to senior level data engineer. The ideal candidate will have broad knowledge across data engineering tools and practices and preferably with some experience in web scraping. Our organisation deals with a vast range of data feeds and our business evolves quickly. We are constantly responding to new opportunities as they arise. You will need to be comfortable working in a complex data environment and comfortable with rapidly prototyping, deploying and iterating on our solutions.  You will be working on real-time data pipelines for live sports events where your expertise will help us advance our in-play sports analytics and pricing function. Your day-to-day will involve developing robust and scalable data pipelines, implementing new feeds into the business, and integrating them with our quantitative decision models.   If you have experience working with sports or financial markets data and quantitative analytics models we would be excited to hear from you. 

Key Responsibilities

• Design, build, and maintain robust, scalable and efficient data pipelines. 
• Develop a general framework to process, clean and transform web-scraped data to ensure consistency and usability. 
• Develop data services within event-based architectures.
• Develop and optimise web-scraping tools. 

Skills, Knowledge and Expertise

• Proven experience as a data engineer or similar, with a track record of handling mid to large scale data projects. 
• Strong proficiency in Python, JavaScript, SQL, Scala, Golang (expert/advanced in at least one). Experience in at least one cloud platform (preferably GCP).
• Basic knowledge of statistics and machine learning.
• Experience with streamed data processing, parallel compute, and/or event based architectures.
• Experience with web-scraping tools and techniques 
• Experience with bots and process automation
• Experience with Spark, Apache services, ETL tools, Data visualization and dashboards.
• BSc/MSc in computer science, maths, physics or STEM subject.

Benefits

• Salary depending on experience.
• Annual discretionary performance bonus.
• 25 days holiday per annum, plus UK bank holidays.
• Private health & dental insurance.
• Optical cover through Aviva. 
• Pension plan.
• Gympass membership to over 1900 gyms and wellness businesses. 
• Breakfast bought in everyday and lunch bought in twice a week
• Free coffee & snacks at the office.
• Regular team events & socials.