Principal Data Engineer
Fitzrovia, England, United Kingdom - Remote
Xiatech
Embrace Hyper-Integration through Xfuze. Connect your systems, unify your data and deliver insights to accelerate business transformation.About us
Here at Xiatech, we believe that a great work-life balance leads to a contented and productive team. We enable all our teams to work remotely in order that they enjoy the flexibility and freedom to work at a time and place convenient to their lifestyle. Of course, when it comes to the serious stuff of doing business, everyone at Xiatech makes themselves available and delivers to a high standard.
Using the latest in Open Source, Microservices, Big Data and Cloud technologies, Xiatech has developed Xfuze, an innovative Hyper-Integration Platform.
Xfuze (https://www.xiatech.co.uk/platform/hyper-integration-platform/) provides organisations with three core capabilities in a single platform:
- Real-time system integration
- Real-time, single view of data
- Real-time, actionable insights, including predictive analytics
The Role
We’re looking for a Principal Data Engineer to define and develop the features and functionality of the Xfuze Platform, including involvement in the roadmap, orchestration, and prioritisation of new requirements.
You will lead data engineers as a Technical Leader in the company and build up the Xfuze platform. You will inspire your team and they will look up to you technically to guide them.
You will work closely with the CTO, CDO, client business teams, Xfuze platform teams, stakeholders, and your peers in the technical development team, ensuring all requirements and views are represented in delivering the final Xfuze product.
The ideal candidate will be passionate about tech and keep abreast of industry trends and emerging technologies. They will be comfortable working with different tools as needed and sharing that knowledge with others.
This is a fantastic opportunity for a driven individual looking for a role in a company which can offer career progression, personal development and on-the-job training. This exciting role will have a genuine impact from day one and will enable the right person to progress their career in a rapidly expanding organisation.
Key Responsibilities
- Provide technical leadership to a team of data engineers, fostering a culture of collaboration, innovation, and excellence.
- Define the data engineering strategy & roadmap, including breaking this down into epics and stories for the squads you work with.
- Design and implement scalable and efficient data architectures that support the business objectives.
- Work with Product Owners to prioritise and orchestrate work between squads and engineers, including setting non-functional requirements.
- Drive change and continuously improve the company’s data engineering practices & maturity.
- Provide governance through the technical design authorities.
- Evaluate and select tools and technologies that align with the organisation's strategy.
- Set and track technical metrics to assess the performance of the team and the solutions they build.
- Help the organisation scale by improving our onboarding, training, and SDLC processes.
- Hands-on building of our next-generation XFuze platform using agile methodologies.
- Data Quality engineering, implementing patterns that clean and enrich data in reliable ways.
- Mentor and improve the technical skills of other team members through peer reviews.
- Work with clients to analyse requirements and implement solutions.
Your Knowledge & Experience
- 7+ years experience in Data Engineering/Architecture (or similar).
- Broad knowledge of different technical areas (DevOps, Engineering, Architecture, Various Datastores, etc).
- Strong proficiency in SQL & Python.
- Experience working with Spark (Pyspark), data streaming, and big data solutions. Experience with Databricks is a bonus.
- Designing and building data warehouses & data lakes, including data modeling and mapping using techniques such as medallion and star schema (Experience with BigQuery a bonus).
- Data pipeline/ETL Development, building ingestion pipelines that produce scalable data products as outputs for analytics.
- Orchestration frameworks such as Dataform, Airflow, and GCP Workflows.
- Cloud platforms, especially GCP services such as GCS, Cloud Functions, and Dataproc.
- Familiarity with containerization and IaC tools (e.g. Docker, Kubernetes, Terraform).
- Worked within an agile environment (Scrum, Kanban, etc).
- Previous experience in the retail domain is highly desirable.
- Excellent communication and presentation skills.
Your Personality
- Innovative
- Driven
- Resilient
- Insightful
- Empathetic
- Analytical
- Self-Starter
- Creative
- Problem solver
If you would like the opportunity to join an established UK-based Software as a Service organisation who believe in using the latest leading-edge technology to drive business growth, please enquire now by emailing maddie@xiatech.co.uk.
If you receive an offer of employment, this will be conditional upon satisfactory completion of a right to work & identity check, a reference check and a basic criminal record check for any unspent convictions.
Xiatech is proud to be an equal opportunity employer and prohibits discrimination and harassment of any kind.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow Architecture Big Data BigQuery Databricks Dataproc Data quality DevOps Docker Engineering ETL GCP Kanban Kubernetes Microservices Open Source Pipelines PySpark Python Scrum SDLC Spark SQL Streaming Terraform
Perks/benefits: Career development Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Data Manager jobs
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Data Scientist II jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Junior Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open DevOps-related jobs