Senior Data Engineer: Hybrid Role

The future of insurance starts with AI. To date, Shift Technology's AI-powered products have benefitted more than 300 million policyholders globally by reducing underwriting risk, identifying more fraud, and automating critical tasks throughout the claims process.  Shift harnesses the power of AI to enable the world’s leading insurance organizations to make better decisions. Our products help insurers improve operational efficiency, reduce costs, and deliver superior customer experiences to their policyholders.  Our culture is built on innovation, trust, and a drive to transform the insurance industry by imagining and innovating solutions that impact insurers and their customers - like you! We come from more than 50 different countries and cultures and together we are creating the future of insurance.

About the Engineering Team: 

Our Engineering team lies at the core of the value we offer to our customers. We solve complex problems by working not only within our squads, but also by working collaboratively with other teams across the organisation. Our company tech stack includes .Net Core (C#), Python, MS SQL Server, Elastic Search, and more. If you are excited by solving complex technical challenges, this is the right place for you! We are in a process of moving towards distributed data on cloud platforms and have challenging opportunities in optimizing both bulk and real-time processing!

Detection Squad

What you’ll do

• Define, design and drive software architecture in partnership with software engineers to enable quick and easy consumption of data
• Understanding how the Data Model and ETL Mapping transforms through the software framework
• Improve, deliver, maintain and support new & existing features in our customer products
• Contribute to Shift’s new technologies adoption by monitoring technological development, driving research and building POCs
• Provide technical guidance to peer engineers and help them to upskill
• Actively Document and Diagram the technical design and architecture.

What you bring...

• You have at least 4 years of experience in software development 
• You have strong coding skills: solid experience with Python would be ideal, but any other OOP language is ok!
• Apache Spark a must, with experience debugging, hardening and optimising pipelines
• 3+ years of SQL database, CosmosDB/MongoDB
• 3+ years experience in custom ETL design, implementation and maintenance
• 3+ years experience with Data Modeling
• You have a good understanding of distributed data systems 
• You understand data warehousing concepts, have experience in resolving performance and scalability issues on data pipelines
• Bonus Experience with stores: feature store, vector database,
• Nice to have: OLAP db, GraphDB, Databricks DBT / SQL mesh (Niche) ML Ops
• You are used to work closely with cross-functional teams including data scientists or engineers
• You can communicate clearly in English 

 Recruitment Process

• HR Screening
• Technical Screening with a software architect
• Second Technical screening with a Data Engineer
• Final Round with Hiring Manager 

#LI-BA1 #LI-ONSITE  #LI-HYBRID

To support our permanent, full time employees at every stage of their careers and lives, we provide a competitive total rewards and benefits package. Here are the global benefits we’d like to highlight:

• Flexible remote and hybrid working options
• Competitive Salary and a variable component tied to personal and company performance
• Company equity
• Focus Fridays, a half-day each month to focus on learning and personal growth
• Generous PTO and paid holidays
• Mental health benefits 
• 2 MAD Days per year (Make A Difference Days for paid volunteering)

Additional benefits may be offered by country - ask your recruiter for more information. Intern and Apprentice position are eligible for some of these benefits - ask your recruiter for more details.

At Shift we strive to be a diverse and inclusive workforce. We hire and trust people without regard to race, color, religion, marital status, age, national or ethnic origin, physical or mental disability, medical condition, pregnancy, genetic information, gender identity or expression, sexual orientation, or other non-merit criteria.

Shift Technology is committed to providing reasonable accommodations for qualified individuals with disabilities in our application and employment process. Should you require accommodation, please email accommodation@shift-technology.com and we will work with you to meet your accessibility needs.

Shift Technology does not accept unsolicited CVs from recruiters or employment agencies in response to the Shift Technology Careers page or a Shift Technology social media post. Any unsolicited CVs, including those submitted directly to hiring managers, are deemed to be the property of Shift Technology.