Principle Software developer (Big Data)
Mumbai, India
Nielsen
A global leader in audience insights, data and analytics, Nielsen shapes the future of media with accurate measurement of what people listen to and watch.This position is responsible for participating as a developer in highly-complex or business-critical applications, as well as testing, and supporting them as needed.
Job Responsibilities:
- Experience in building data pipelines using Spark
- Good understanding of Data Warehousing and Data Modelling concepts on AWS Redshift
- Consultative approach - the ability to analyze and resolve complex problems in collaboration with customers and colleagues
- Consultative approach - the ability to analyze and resolve complex problems in collaboration with customers and colleagues
- Experience and advanced knowledge in building Analytics solutions using traditional ETL tools or Big Data technologies
- Has good experience with message driven software patterns (Kafka, MQ) and big data technology ( Hdfs, Hive, Hbase, Spark, Cassandra, Elasticsearch, etc.)
Tech Stack Requirements:
- Java, Scala, Big Data, Hadoop, Spark, Spark SQL, Presto \ Hive,
- SQL, Cloud (preferably AWS), Docker, RDBMS (such as Postgres and/or Oracle), Linux, Shell scripting, GitLab, Airflow.
Role Requirements (Essentials)
- Minimum 4 years of experience designing & delivering software solutions that address complex cross-domain problems
- Knowledge of at least one modern programming language (Python, golang etc) and related frameworks
- Experience with agile software delivery processes including practices like automated testing and CI/CD
- Experience developing cloud native applications on platforms like AWS, GCP,
- Understanding of software skills such as business analysis, development, maintenance, and software improvement
- Experience and advanced knowledge in building Analytics solutions using traditional ETL tools or Big Data technologies
- Experience in AWS Data Analytics platform and related services - S3, AWS Glue, Athena, Lambda etc
- Excellent written and spoken communication skills
- Ability to collaborate with different roles to achieve common goals
- Experience on RDBMS databases is also good plus
#LI-AR1
Tags: Agile Airflow Athena AWS Big Data Cassandra CI/CD Data Analytics Data pipelines Data Warehousing Docker Elasticsearch ETL GCP GitLab Golang Hadoop HBase HDFS Kafka Lambda Linux Oracle Pipelines PostgreSQL Python RDBMS Redshift Scala Spark SQL Testing
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs