Data Engineer
Warsaw - Poland
Applications have closed
Dun & Bradstreet
About the roleYou will be part of the team that is responsible for the accuracy and integrity of our UK and Ireland Identity Data. You will deliver and maintain data engineering solutions that ensure consistent operation of our UK and Ireland Data Management System. You will develop new innovative processes to manage data quality and streamline existing processes to execute data improvement plans more efficiently and effectively. You will also be key technical support in conversations with our data partners to help understand their data and ensure we are maximizing value from all our data sources
Key Responsibilities
- Day-to-day operations of our Data Management System; ensuring process and procedures run as expected and any bugs are fixed in a timely manner with business-critical processes prioritised
- Architecting solutions; Design, develop and test fit for purpose, resilient, scalable, and future-proof data services.
- Recognise and exploit opportunities to ensure efficient and effective performance of Data processes. Explore new ways of conducting operational processes; developing ways of maximising the update cycle on data; achieving the best cost model whilst maintaining data quality
- Write ETL scripts and code to make sure ETL processes perform optimally
- Design, write and iterate code from development to production-ready. Understands security, accessibility, and version control. Can use a range of coding tools and languages.
- Plan, design, manage, execute, and report tests, using appropriate tools and techniques, and works within internal policy and regulations. Ensuring risks associated with deployment are adequately understood and documented
- Design and maintain appropriate metadata repositories to enable understanding of data assets and full auditability.
- Partnering with cross-functional teams to understand how new sources will contribute towards the ongoing enhancement of data assets to achieve goals for database size, completeness, and other desirable improvements.
- Creation of operational reports to measure usability and performance of data sources
- Contribute to the vision and scope for the next generation of our data to drive revenue, performance quality and ensure operational efficiency, including new types of data and emerging capabilities for data collection.
- Support operational plans that deliver business requirements through leading and coordinating their development, testing, and managing stabilisation activities.
What we're looking for
- 3+ years of proven in-depth knowledge and experience of SQL and database querying languages
- Knowledge of other languages, like Python, would be advantageous
- Ability to use PowerBI would be advantageous
- Experience with ETL tools, in particular SSIS (SQL Server Integration Services)
- Experience working with API’s and services
- Has a demonstrable understanding of how to expose data from systems (for example, through APIs), link data from multiple systems using different storage technologies/access methods and deliver streaming services. Creates repeatable and reusable procedures.
- Ability to correctly execute test scripts under supervision. Understanding the role of testing and how it works.
- Aware of the types of problems in databases, data processes, data products and services.
- Ability to run development using Agile and Kanban methodologies
- Dynamic and results-driven with the focus on facilitating action and effecting change
- An innovative and inspirational approach
- Self-motivation with the desire to learn new techniques – relentlessly curious
- Demonstrable experience in Database design, modelling and best practice
- Analytical, process and problem-solving skills in a highly complex environment. A clear thinker who can articulate database issues and solutions and gain support for implementation, whilst remaining focused on what is important.
- Ability to prioritise and multitask with flexible approach to changing deadlines and scope of project
- Ability to work independently
- A great team player
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Data management Data quality Engineering ETL Kanban Power BI Privacy Python Security SQL SSIS Streaming Testing
Perks/benefits: Flex hours
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Senior Data Architect jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Manager jobs
- Open Data Quality Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs