Senior Data Engineer

Company Description

Senior Data Engineer

Basingstoke

Reassured Ltd is the largest non-advised life insurance intermediary in the UK with established locations in Basingstoke, Portsmouth, Southampton, Manchester, Bristol, Bournemouth and Chester.

We launched our new Advised business offering in 2021 and continue to grow our sales and support teams across the entire business this year. We arrange over 15,000 new customer life insurance policies per month with leading sales conversions and customer satisfaction metrics. The business is outbound, B2C sales from internet generated customer enquiries.

Job Description

As a Senior Data Engineer you will be the lead in the team and your role will be to metamorphose the raw data into something viable and readable before its presentation to the stakeholders. You will also be required to design, build, test, blend, manage, and optimise the data using all resources available to you.

Key Responsibilities

• Designing and implementing performant data ingestion pipelines from multiple sources using Apache Spark (ideally in Azure Databricks)
• Delivering and presenting proofs of concept of key technology components to the wider data team and project stakeholders.
• Integrating the end-to-end data pipelines to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
• Working with event based / streaming technologies to ingest and process data
• Working with other members of the data team and wider business to support delivery of additional project components (API interfaces, Data Models, Data Sharing, ML Endpoints)
• Working within an Agile delivery / DevOps methodology to incremental change to the overall data platform to deliver additional data products to provide value to stakeholders.

Qualifications

 Knowledge

• Excellent level of proficiency in writing SQL
• Strong SQL and Python experience.
• Strong knowledge of Data Management principles in a Lakehouse Architecture.
• Hands on experience designing and delivering solutions using Azure services including Azure Data Factory, Azure Databricks, Azure Synapse, Azure Storage, Azure DevOps.
• Experience managing data solutions deployments using Azure DevOps (CI/CD)
• Experience with Terraform and Ansible
• Experience working with BI Developers to collaborate on the design of data models (Star Schema) for use in Power BI
• Experience working with Data Scientists to productionise ML pipelines into the overall data platform solution
• Microsoft Azure Data Engineer certifications

 Desirable Experience

• Experience implementing real-time pipelines to power real-time dashboards
• Experience with CDC (Change Data Capture) tools (Arcion, Qlik Replicate, Matillion)
• Experience with open-source tools such as Apache Kafka
• Experience working with unstructured data including voice data
• Working in a heavily regulated industry (Finance, Insurance)

Key Competencies

• A logical, analytical and creative approach to problems.
• Passion and ability for learning new skills and technologies.
• Good communication skills.
• A meticulous and organised approach to work, with a thorough attention to detail.
• Business and commercial awareness.
• The ability to work autonomously whilst working in a team environment.
• An awareness of current issues affecting the industry and its technologies

 Qualifications

• Educated at graduate level preferred but not essential
• A minimum of 5 years experience
• Previous experience in the creation of data platforms in a commercial environment.

Additional Information

Benefits

We offer an excellent range of benefits, and some are accessed upon completion of probation. Crucially we believe in developing your career and clearly lay out the path for you to be successful and progress.

• Monthly and Quarterly Bonus Schemes
• Hybrid working once fully trained
• Long term bonus opportunities
• Career Development, including supporting personal development
• Pension Scheme
• Employee Assistance Program, includes face to face counselling sessions
• Retail discounts
• Annual pay reviews
• A range of flexible benefits

Reassured Ltd is the UKs largest provider of Life Insurance. Reassured Ltd is an Equal Opportunity Employer with a strong commitment to the achievement of excellence and diversity among its employees.