Data Engineer
London, UK
Full Time Mid-level / Intermediate GBP 70K - 85K
White Swan Data
Department: Engineering
Employment Type: Full Time
Location: London, UK
Compensation: £70,000 - £85,000 / year
Description
We are seeking a skilled mid to senior level data engineer. The ideal candidate will have broad knowledge across data engineering tools and practices and preferably with some experience in web scraping. Our organisation deals with a vast range of data feeds and our business evolves quickly. We are constantly responding to new opportunities as they arise. You will need to be comfortable working in a complex data environment and comfortable with rapidly prototyping, deploying and iterating on our solutions. You will be working on real-time data pipelines for live sports events where your expertise will help us advance our in-play sports analytics and pricing function. Your day-to-day will involve developing robust and scalable data pipelines, implementing new feeds into the business, and integrating them with our quantitative decision models. If you have experience working with sports or financial markets data and quantitative analytics models we would be excited to hear from you.Key Responsibilities
- Design, build, and maintain robust, scalable and efficient data pipelines.
- Develop a general framework to process, clean and transform web-scraped data to ensure consistency and usability.
- Develop data services within event-based architectures.
- Develop and optimise web-scraping tools.
Skills, Knowledge and Expertise
- Proven experience as a data engineer or similar, with a track record of handling mid to large scale data projects.
- Strong proficiency in Python, JavaScript, SQL, Scala, Golang (expert/advanced in at least one). Experience in at least one cloud platform (preferably GCP).
- Basic knowledge of statistics and machine learning.
- Experience with streamed data processing, parallel compute, and/or event based architectures.
- Experience with web-scraping tools and techniques
- Experience with bots and process automation
- Experience with Spark, Apache services, ETL tools, Data visualization and dashboards.
- BSc/MSc in computer science, maths, physics or STEM subject.
Benefits
- Salary depending on experience.
- Annual discretionary performance bonus.
- 25 days holiday per annum, plus UK bank holidays.
- Private health & dental insurance.
- Optical cover through Aviva.
- Pension plan.
- Gympass membership to over 1900 gyms and wellness businesses.
- Breakfast bought in everyday and lunch bought in twice a week
- Free coffee & snacks at the office.
- Regular team events & socials.
Tags: Architecture Computer Science Data pipelines Data visualization Engineering ETL GCP Golang JavaScript Machine Learning Physics Pipelines Prototyping Python Scala Spark SQL Statistics STEM
Perks/benefits: Career development Fitness / gym Health care Salary bonus Team events Wellness
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Product Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Research Scientist jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open PhD-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Snowflake-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs