Data Engineer
London, England, United Kingdom
Applications have closed
Evaluate
Trusted commercial intelligence, consensus forecasts, Vantage news and analysis for pharma, biotech and medtech industry - Explore EvaluateEvaluate is a global company providing market intelligence services for the Pharmaceutical, Medical Device, Financial and Consulting sectors, through the Evaluate Pharma®, Evaluate Medtech®, Evaluate Omnium and Evaluate Vantage® brands. Our international clients in Pharma and Biotech, Medtech, Banking and Consultancy regard Evaluate Pharma® as the industry’s gold standard for timely and accurate analysis of reported drug sales, consensus sales forecasts, R&D pipeline, markets and comprehensive company financials.
THE TEAM
Building on this success, we know there is more scope for advanced data processing and data science, and this year Evaluate is investing heavily in the data science team. The team consists of a blend of seven data engineers and data scientists with wide-ranging skills. It is based in London with extra specialist support in Ukraine via our technology partner for CI/CD and data warehousing.
As part of our growth we are looking for new data engineers to help support the production of new products. We have small multi-functional teams consisting of pharmaceutical industry experts, R&D, data engineering and data scientists to rapidly prototype new visualisations and interactive reports using both our existing and newly acquired datasets.
SCOPE OF THE ROLE
In this role as a Data Engineer, you will:
- Design and optimisation of database solutions that sit upstream of main production environment
- Creation of optimised upstream database systems, e.g. consolidated/standardised clinical trial or pricing database (across multiple geographies)
- Pulling, processing and structuring new data sets, from public and private sources, e.g. research abstracts
- Automate data pipelines using Airflow and AWS serverless compute services
- Develop & maintain data publication and synchronization processes, supporting Tableau
- Productionising Tableau data transforms
HOW YOU’LL SUCCEED
You will work with R&D pharma specialists to understand a problem which is hindering developing and releasing effective new pharma products which we believe we can help with. After understanding the problem and how it can be solved, you will work with Tableau visualisation teams to provide carefully curated and transformed data for the product.
The data sources may be already available in Snowflake, and simply require dedicated views, or be more complex such as ingestion of external datasets, use of web crawlers to gather data, or to join with data from other companies within the Norstella group. Working with the broader product team, this dataset will be continuously updated, cleaned, and refined.
After iterating the design with the visualisation team, the prototype will be demoed and if suitable converted into a full production product. This will involve productionising the pipeline using Airflow, ensuring it is automatically refreshed with data if required, and putting in place monitoring and alerts so any issues can be identified and solved rapidly.
Requirements
WHAT IT TAKES
- Bachelor degree in Computer Science, similar technical field of study or equivalent practical experience
- Excellent SQL querying skills and stored procedure creation skills
- Experience handling large data sets in formats such as XML, JSON and CSV
- Building data pipelines (using common tools such as Snowflake Snowpipes)
- Good Python knowledge (2-3 years), with a focus on data manipulation
- AWS Data services (S3, Glue, MWAA)
- Superior communication skills, friendly approach to business and the ability to grow and adapt as business does
- Finger on the pulse with new & emerging technologies
Desirable:
- AWS certifications
- Snowflake certifications
- Experience with data visualisation tools such as Tableau, Power BI or QuickSight
Benefits
WHAT WE OFFER YOU
- 25 days holiday (increasing to 30 over 9 years) + 8 bank holidays
- Value You Day - one additional wellbeing day on top of your holiday allowance
- Pension plan - company contribution of 6.7% rising to 10% after 12 months service
- Life Assurance 4 x salary
- Employee Assistance Programme (EAP)
- Private Medical Insurance*
- Corporate Gym Membership/Discount*
- Flexible working and flexitime policies
- Season Ticket Loan*
- Cycle to Work Scheme
- Maternity, Paternity & Adoption leave – including enhanced leave for 2+ years’ service
- Shared parental leave
(*following successful completion of probation period)
Evaluate is an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age. Our ethos is to respect and value people’s differences, to help everyone achieve more at work as well as in their personal lives so that they feel proud of the part they play in our success. We believe that all decisions about people at work should be based on the individual’s abilities, skills, performance and behaviour and our business requirements. Evaluate operates a zero tolerance policy to any form of discrimination, abuse or harassment.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow AWS Banking CI/CD Computer Science Consulting CSV Data pipelines Data Warehousing Engineering JSON Pipelines Power BI Python QuickSight R R&D Research Snowflake SQL Tableau XML
Perks/benefits: Career development Fitness / gym Flex hours Health care Insurance Medical leave Parental leave
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open AI Engineer jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs