Data Ops Engineer

Who are LRQA?

LRQA stands for dedication to clients, market firsts, and deep expertise in risk management. We’ve grown to become a leading global assurance provider, bringing together outstanding expertise in certification, customised assurance, cybersecurity, inspection and training.

While we’re proud of our heritage, it’s who we are today that really matters, because that’s what shapes who we and our clients can become tomorrow. By staying true to our shared values and combining decades of collective experience, we support our clients in building a safer and more sustainable future.

What do we do?

We help our clients negotiate a rapidly changing world, by working with them to manage and mitigate the risks they face. We serve a wide variety of industries, from food, beverage and hospitality to automotive,  aerospace and transportation.

From independent third-party auditing, certification and training; to consultancy services; to real- time assurance technology; to data-driven supply chain transformation, our innovative end-to- end solutions help our clients shape their own future, rather than letting it shape them.

LRQA currently operates across 51 countries, has more than 2,500 colleagues and supports more than 60,000 clients across a diverse range of sectors and markets.

The next chapter for LRQA

The future of business assurance is exciting and rapidly changing. New challenges and opportunities are arising all the time. We’re adapting to these challenges by expanding our portfolio of services and aiming to become the leading digitally enabled assurance provider.

In November 2021, Goldman Sachs Asset Management acquired the LRQA business from Lloyd’s Register Group, of which it had previously been a part. Becoming an independent business accelerates our ambition to realise this vision. We will now be able to:

•             Invest in customer excellence.

•             Build on strong foundations to lead the digital transformation of assurance.

•             Invest to enhance our products and services.

•             Accelerate the growth of the business and deliver on our sustainability strategy.

With solid expertise and heritage in our sector, coupled with well-timed accelerated investment and a leadership team that is fully committed to delivering our vision, LRQA’s next chapter is set to be an exciting, transformational period of growth. We’re well placed to build on everything we’ve done and further our ambitions for the future. At such an exciting time key talent is critical, and this role is a great opportunity to be part of our next chapter.

Role Purpose

The DataOps Engineer will work closely alongside Data Engineering, Data Science, Data Analytics and DevOps to ensure availability of our Azure data platform.  The role will ensure best practices are followed focusing on automation, scalability and security.  The main responsibilities include monitoring infrastructure and data pipelines, implementing and monitoring CI/CD pipelines, administering our Databricks Lakehouse platform including configuring and optimising clusters, and managing role-based access control.

Key Responsibilities

• Monitoring existing data pipelines, resolving issues and recommending areas for improvement
• Monitoring our existing infrastructure ensuring it is available and scalable to meet the needs of the business
• Creating and maintaining CI/CD pipelines in Azure DevOps
• Administering Databricks/Unity Catalog – creating and managing clusters and setting up RBAC
• Identifying infrastructure cost optimisations
• Setting up linked services in Azure Data Factory

Technical Requirements

• Experience monitoring Azure Data Factory pipelines
• Experience creating linked services in Azure Data Factory utilising Azure Key Vault
• Good knowledge of Azure data services
• Understanding of Data Engineering/Software Engineering best practices
• Experience creating CI/CD pipelines in Azure DevOps
• Databricks Workspace Administration
• Understanding of implementing identify and access management
• Setting up Unity Catalog (desirable)
• Infrastructure as code - Terraform (desirable)
• Knowledge of cloud networking (desirable)