Senior Data Engineer

At The Data Shed, we've been working with some truly inspiring clients on anything from real-time data integration and data mining to analytics-ready data modelling and insight elicitation with data exploration and Machine Learning. The Data Shed is also offering a solution for business-wide Single View of Customer systems as a SaaS product.

We face new and exciting challenges every day, from ensuring high availability and performance of critical government systems, to understanding and improving complex banking and finance data structures.

Our Data Engineers find themselves working on a broad range of data-centric technologies across the major cloud providers such as Amazon Web Services (AWS), Azure, and Google Cloud Platform (GCP). While our teams have commonly used Python, SQL, Java, and JavaScript as well as a small amount of C#, we expect engineers to be agnostic to technology—valuing their ability to be adaptable and learn quickly.

As part of our engineering team, you will be responsible for building large-scale data management and analytics platforms. We use a variety of tools, making sure we use the right one for the job at hand. As a close-working and collaborative team, we make data valuable and available to our clients, through consultancy services or product development.

Skill & Experience

At The Data Shed we are looking for experience in the following things. We need people who are open to new technologies, quick to adapt, and quick to learn. If you don’t have one of the following, please apply and we can discuss in more detail.

• Can write code and tests in at least one core language
• Comfortable with SQL and relational databases and/or NoSQL databases
• Strong experience of at least one Cloud provider such as AWS, Azure or GCP
• Comfortable working with different data formats, e.g., CSV, JSON and XML
• Working on and automating Extract Transform and Loading (ETL) processes
• Experience of Exploratory Data Analysis
• Data Preparation—one or more of: Data Cleaning, Data Quality, Anomaly Detection, Data Integrity, Data Lineage
• Broader knowledge of IT — e.g., Security and Networking
• Working in a fast-paced, agile environment
• Test-driven approaches such as Test-Driven Development and/or Behaviour Driven Development
• Continuous Integration and Continuous Deployment (CI/CD)

Optional Experience

The following is optional, but highly desirable experience!

• Experience in technical leadership of a team
• Stakeholder management skills & experience
• Experience of visualising data
• Working with Metrics, Segments, Aggregates, Features

Requirements

• Assist our clients in enterprise-scale projects utilising best-practice development methodologies, well tested
• Spend as much time on tests and security as on writing code.
• Work with a team of like-minded, high-calibre engineers to translate user requirements into working
• Lead definition and maintenance of best practice and standards in development and design principles
• Make it right and only then make it fast.

• Mentor Engineers and advise on technical competencies around core Shed technologies including e.g. programming, cloud platforms etc.
• Assist the Tech Lead in shaping and amending tech roadmap.
• Understand value added / lost both to Customers and the Shed.
• Maintains comprehension of the end-to-end solution and associated architecture.
• Encourage delivery practices to be adhered to by team.
• SME (Subject Matter Expert) in one or more chosen and relevant Technologies / Languages.
• Able to work independently as the sole Engineer on small projects / proof of concepts if required.
• If you see something that’s broken, fix it. That includes the coffee machine.

Benefits

We have a variety of benefits including free access to an Employee Assistance Program, private medical insurance, an auto enrolment pension scheme, a life assurance scheme, regular socials and a company performance-based bonus and for any additional needs you have, we have a friendly and knowledgeable HR team to support you.

The role can be performed in a hybrid fashion. Working from home is something we have done successfully through the pandemic, and we will be continuing in this vein moving forward. You will be expected to come in with your client team at least once per fortnight. However, the office will remain open for those who wish to come in more often. We have multiple ‘Shedders’ who utilise the office and you’re always welcome to join! Travel to client sites may be required from time to time.

Culture in The Data Shed

Like many other organisations we recognise the importance diversity plays in creating a successful, balanced, and fair organisation which is why The Data Shed prides itself on having an inclusive culture.

The Data Shed is an equal opportunities employer, and we know how important it is to have a good work-life balance. We do our best to allow every member of the team a working pattern that suits them, whether that’s being around for school pickups or taking a longer lunch to walk the dog. As long as your team and clients have been considered then we’re confident in our approach to treat everyone like adults, with wellbeing as a priority.

Location

This is a remote role as we have a Leeds HQ. We have a growing team in Edinburgh. Travel to client site may be required from time-to-time.

Ready to be a Shedder?

Your employment will be subject to your satisfactory completion of a probationary period, a reference being provided by your previous employer and the completion of a Disclosure and Barring Service check.

We also celebrate each other’s differences and encourage each other to explore new ways of thinking. The result is a diverse set of individuals who come together to create a multi-talented, cohesive organisation. If you think that your uniqueness could make us even stronger, then please get in touch!