Senior Data Engineer - W6052

What You'll Do

• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organization.
• Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Write unit/integration tests, contributes to engineering wiki, and documents work.
• Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
• Work closely with a team of frontend and backend engineers, product managers, and analysts.
• Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
• Design data integrations and data quality framework.
• Design and evaluates open source and vendor tools for data lineage.
• Work closely with all business units and engineering teams to develop a strategy for long term data engineering platform architecture

What You Know

• A minimum of 8 years of ETL and Data Engineering experience is required.
• Experience with relational SQL and NoSQL databases.
• Experience with Azure cloud Data services
• 5-8+ years of experience in a Data Engineer & ETL Tools (any one tool) role (Azure)
• Data Engineer with Azure functions and Azure ADF, Databricks and PySpark
• Experience with object-oriented/object function scripting languages: Python, Scala, etc.
• Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.

Education

• A bachelor's degree in information technology, software development management, software engineering, computer science, or a related field.

Benefits

• In addition to competitive salaries and benefits packages, Nisum India offers its employees some unique and fun extras:
• Continuous Learning - Year-round training sessions are offered as part of skill enhancement certifications sponsored by the company on a need basis. We support our team to excel in their field.
• Parental Medical Insurance - Nisum believes our team is the heart of our business and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
• Activities -From the Nisum Premier League's cricket tournaments to hosted Hack-a-thon, Nisum employees can participate in a variety of team-building activities such as skits, and dances performance in addition to festival celebrations.
• Free Meals - Free snacks and dinner is provided on a daily basis, in addition to subsidized lunch.