Data Engineer - Scala & Spark

Join our vibrant and specialist technology team, helping grow our Data Platforms team. This is a great opportunity to contribute to the business strategy, go to market and deliver on our team objectives. So, if you have an entrepreneurial flair, grounded in technology delivery then this is the team for you.

We are looking for Mid level who are passionate about developing their career further and working alongside our talented engineers and architects. This Is a opportunity to work alongside our Head of Data Consulting with one of our private clients.

We are looking for Individuals who have experience working Ina agile team Including the following

Requirements

We are looking for engineers who can demonstrate experience in the following areas:

• Recent hands-on experience with Scala and Spark.
• Experience with Python
• Experience with Databricks and the creation of notebooks
• Experience with Azure DevOps and Git source control mechanisms
• Experience with Azure Data factory – specifically creating pipelines via code (YAML)
• MSSQL/TSQL experience

Candidates should also be able to demonstrate that they are able to:

• Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces.
• Develop data transformations to address key data constraints and improve overall data quality
• Understand where the need for tight data controls arises to ensure seamless data flows around the organisation and to minimise future change.
• Model data requirements, data sources and data flows to bring order and structure to programmes of work.
• Define how and where data is created, mastered and destroyed to ensure proper control over the lifecycle of corporate data assets.
• Understand how to add value to data – for example through data cleansing.
• Understand categories of products (and individual examples) that can be used to collect, integrate, store, visualise and govern data and metadata.
• Define metadata to provide searchability and governance (including Records Management) for unstructured data.

Why 6point6?

At 6point6, we drive the right change in every organisation through the positive impact of technology. Leading with strategy, architecture, and design, we connect cloud, data, and cyber to engineer and deliver large-scale, complex transformations across public and private sectors. We help organisations realise the value of their business strategy, allowing them to engage in a more meaningful way with their end customers.

Benefits

We offer a competitive salary & benefits package, for more details of our benefits package please see - https://6point6.co.uk/careers/