Senior Data Engineer (R-16183)
Hyderabad - India
Dun & Bradstreet
Team Overview:D&B’s Canada Data and Operations team are the owners of our Canada data supply chain. We are responsible for the quality of Canada business data and the supply chain delivering that data to customers. Our team partners with our Global Data Owners, Technology, Operations, and Sales teams to implement our Canada data improvement strategy.
We leverage technology to transform our data maintenance from a reactive, manual update process to a proactive automated data maintenance process. This transformation is a wealth of opportunity for anyone who can innovate and deliver improved data quality on a larger scale, with faster turnaround time and higher efficiency.
The Role
- The data engineer will report directly to the Data & Operations leader for Canada.
- Responsibilities will be
- Work with other data engineers and SMEs to improve the overall quality of data delivered to customers
- Develop data ingestion and mastering processes on new structured and unstructured data sources to synthesize new insight and enhance production database
- Identification, design and implementation of complex process improvements including redesigning current infrastructure/process for greater scalability
- Automation of manual processes
- Design and implementation of data mastering infrastructure to support development and production environments using AWS/GCP and MS-SQL technologies
- Analysis, development, and implementation: Work independently and with the team to develop new data mastering processes to drive data quality
- Operations: Ensure automated data ingestion and mastering engine operates optimally on a daily basis
- Data acquisition and ingestion: Engineer collection and ingestion of new data sources into mastering environment
- Infrastructure optimization and enhancements: Identify and implement efficiency improvements in our mastering environment. Manage cloud environment including migration from AWS to GCP
- Building new analytical processes providing insight to data quality issues and implementation of data improvement solutions
- Build processes to fetch data from open data sources, eg web sites
- Research and implementation of modern data mastering techniques to increase derived insight on disparate data sources
- Support other data engineers with design of ETL processes, code reviews, and knowledge sharing
- Understands security and version controls
- Can use a variety coding tools and languages (SSIS, C#, Python, Git/Bitbucket, APIs)
- Migration from AWS to GCP
Required technical proficiency:
- AWS or GCP certification (including cloud environment administration)
- Microsoft SSIS / MSSQL (queries/procs/functions, performance tuning)
- Sql Server administration (tuning, database design and optimization)
- Python / C# / NoSql
Additional beneficial experience/skills:
- Technology - Graph database technology
- Languages: R
- Machine learning, web technologies
- French language familiarity/proficiency
- Data mapping from multiple data sources
Education/Experience and Competencies
- Bachelor’s degree in computer science, data science, information systems, or other related field or equivalent work experience.
- 5 to 7+ years work experience on large data projects – defining and implementing data analysis and improvement processes in a cloud-based MS-SQL Server environment
- Ability to perform root cause analysis on external and internal processes and data to identify data quality improvement opportunities
- Analytical skills associated with working on large structured and unstructured datasets
- Additional beneficial experience/skills – Graph database technology, R, machine learning, web technologies, data mapping from multiple data sources Strong organization skills with attention to detail
- Ability to clearly communicate problem statement and solution Able to work independently and willing to learn new skills through independent learning
All Dun & Bradstreet job postings can be found at https://www.dnb.com/about-us/careers-and-people/joblistings.html and https://jobs.lever.co/dnb. Official communication from Dun & Bradstreet will come from an email address ending in @dnb.com.
Notice to Applicants: Please be advised that this job posting page is hosted and powered by Lever. Your use of this page is subject to Lever's Privacy Notice and Cookie Policy, which governs the processing of visitor data on this platform.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs AWS Bitbucket Computer Science Data analysis Data quality ETL GCP Git Machine Learning MS SQL NoSQL Privacy Python R Research Security SQL SSIS Unstructured data
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Product Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open PhD-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Snowflake-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs