Senior Engineer ( Python - Big Data)
Pune, India
Applications have closed
NielsenIQ
We’re unrelenting in our pursuit of the most detailed data sets, measuring every consumer transaction to deliver the knowledge that every business needs to drive growth.Job Description
NielsenIQ’s technology teams are working on our new Connected platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on NielsenIQ’s data and insights to innovate and grow.
As a Senior Engineer, you’ll be part of a team of smart, highly skilled technologists who are passionate about learning, data mining and prototyping cutting-edge technologies. Right now, our platform is based in Python, R, Elastic search, Kafka, NiFi, Mongo, Postgres and Snowflake.
As a Senior Software Engineer, you will collaborate with other Engineers, Development teams, Product Owners & Scrum Masters to realize critical business goals. Our team is co-located and agile, with central technology hubs in Europe, Canada, and India.
What you’ll do:
- Write complex algorithms to get an optimal solution for real time problems
- Qualitative analysis and data mining to extract data, discover hidden patterns, and develop predictive models based on findings
- Use distributed computing to validate and process large volumes of data to deliver insights
- Evaluate technologies we can leverage, including open-source frameworks, libraries, and tools
- Interface with product and other engineering teams on a regular cadence
Qualifications
- 5+ years of applicable data engineering experience, including Python& RESTful APIs
- Strong fundamentals in data mining & data processing methodologies
- Strong knowledge of data structures, algorithms and designing for performance, scalability and availability
- Sound understanding of Big Data & RDBMS technologies, such as SQL, Hive, Spark, Databricks, Snowflake or Postgresql
- Orchestration and messaging frameworks: Airflow, Messaging Frameworks (Kafka)
- Experience in Azure or any cloud computing
- Good experience working in containerization framework, Docker is a plus.
- Experience in agile software development practices and DevOps is a plus
- Knowledge of and Experience with Kubernetes is a plus
- Excellent English communication skills, with the ability to effectively interface across cross-functional technology teams and the business
- Minimum B.S. degree in Computer Science, Computer Engineering or related field
Additional Information
About NielsenIQ
NielsenIQ is a global measurement and data analytics company providing the most complete and trusted view of consumers and markets in 90 countries covering 90% of the world’s population. Focusing on consumer-packaged goods manufacturers and FMCG and retailers, we enable customers to defy what’s possible. How? We combine unparalleled datasets, pioneering technology, and the industry’s top talent to create insights that unlock innovation. Join us and change the landscape.
Learn more at: www.niq.com
Want to keep up with our latest updates? Follow us on: LinkedIn | Instagram | Twitter | Facebook
Our commitment to Diversity, Equity, and Inclusion
NielsenIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us.
We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide.
Learn more about how we are driving diversity and inclusion in everything we do by visiting the NielsenIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion/
Tags: Agile Airflow APIs Azure Big Data Computer Science Data Analytics Databricks Data Mining DevOps Docker Engineering Kafka Kubernetes PostgreSQL Prototyping Python R RDBMS Scrum Snowflake Spark SQL
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open ETL Developer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs