Senior Data Engineer - W5987
Hyderabad
Nisum
Learn how Nisum designs and builds customized eCommerce platforms to power enterprises large and small.What You'll Do
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organization.
- Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Write unit/integration tests, contributes to engineering wiki, and documents work.
- Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
- Work closely with a team of frontend and backend engineers, product managers, and analysts.
- Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
- Design data integrations and data quality framework.
- Design and evaluates open source and vendor tools for data lineage.
- Work closely with all business units and engineering teams to develop a strategy for long term data engineering platform architecture
What You Know
- A minimum of 5-8 years of ETL and Data Engineering experience.
- Should have experience with relational SQL and NoSQL databases.
- Should have experience with Azure cloud Data services
- Data Engineer with Azure functions and Azure ADF, Databricks and PySpark
- Experience with object-oriented/object function scripting languages: Python, Scala, etc.
- Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.
Education
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Computer Applications, or related field
Benefits
- In addition to competitive salaries and benefits packages, Nisum India offers its employees some unique and fun extras:
- Continuous Learning - Year-round training sessions are offered as part of skill enhancement certifications sponsored by the company on an as-needed basis. We support our team to excel in their field.
- Parental Medical Insurance - Nisum believes our team is the heart of our business and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
- Activities -From the Nisum Premier League's cricket tournaments to hosted Hack-a-thon, Nisum employees can participate in a variety of team-building activities such as skits, and dance performances in addition to festival celebrations.
- Free Meals - Free snacks and dinner are provided on a daily basis, in addition to subsidized lunch.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Architecture Azure Blockchain Business Intelligence Computer Science Data analysis Databricks Data pipelines Data quality Engineering ETL Excel NoSQL Open Source Pipelines PySpark Python RDBMS Scala Spark SQL
Perks/benefits: Career development Lunch / meals Snacks / Drinks Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Data Manager jobs
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Data Scientist II jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Junior Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open DevOps-related jobs