Senior Associate Data Engineering L2 DE-Big Data AWS
India, India
Publicis Groupe
Company Description
Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value
Job Description
As Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions.
- You will independently drive design discussions to ensure the necessary health of the overall solution.
- The role requires a hands-on technologist who has strong programming background like Java / Scala / Python and should have experience in Data Ingestion, Integration and data Wrangling, Computation, Analytics pipelines, and exposure to Hadoop ecosystem components.
- You are also required to have hands-on knowledge of at least one of the AWS, GCP, and Azure cloud platforms.
Role & Responsibilities:
- Your role is focused on the Design, Development and delivery of solutions involving:
- Data Integration, Processing & Governance
- Data Storage and ComputationFrameworks,PerformanceOptimizations Analytics & Visualizations
- Infrastructure & Cloud Computing
- Data Management Platforms
- Implement scalable architectural models for data processing and storage
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time mode
- Build functionality for data analytics, search and aggregation
#LI-REMOTE
Qualifications
- Overall 5+ years of IT experience with 3+ years in Data related technologies
- Minimum 2.5 years of experience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP)
- Hands-on experience with the Hadoop stack – HDFS, scoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline.
- Strong experience in at least of the programming language Java, Scala, Python. Java preferable
- Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc
- Well-versed and working knowledge with data platform related services on at least 1 cloud platform, IAM and data security
Competency
1. Good knowledge of traditional ETL tools (Informatica, Talend, etc) and database technologies (Oracle, MySQL, SQL Server, Postgres) with hands on experience
2. Knowledge on data governance processes (security, lineage, catalog) and tools like Collibra, Alation etc
3. Knowledge on distributed messaging frameworks like ActiveMQ / RabbiMQ / Solace, search & indexing and Micro services architectures
4. Performance tuning and optimization of data pipelines Job Title: Senior Associate L2 – Data Engineering
5. CI/CD – Infra provisioning on cloud, auto build & deployment pipelines, code quality
6. Cloud data specialty and other related Big data technology certifications
Personal Attributes:
- Strong written and verbal communication skills
- Articulaion skills
- Good team player
- Self-starter who requires minimal oversight
- Ability to prioritize and manage multiple tasks
- Process orientation and the ability to define and set up processe
Additional Information
- Gender Neutral Policy
- 18 paid holidays throughout the year for NCR/BLR (22 For Mumbai)
- Generous parental leave and new parent transition program
- Flexible work arrangements
- Employee Assistance Programs to help you in wellness and well being
* Salary range is an estimate based on our salary survey 💰
Tags: Agile Airflow Architecture AWS Azure Big Data BigQuery Cassandra CI/CD Consulting Data Analytics Data governance Data management Data pipelines Engineering ETL Flink GCP Hadoop HBase HDFS Informatica Kafka MongoDB MPP MySQL NoSQL Oozie Oracle Pipelines PostgreSQL Pulsar Python Redshift Scala Security Spark SQL Streaming Talend
Perks/benefits: Career development Flex hours Flex vacation Health care Parental leave Wellness
More jobs like this
Explore more AI/ML/Data Science career opportunities
Find open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general, filtered by job title or popular skill, toolset and products used.
- Open Junior Data Scientist jobs
- Open Power BI Developer jobs
- Open Data Analytics Engineer jobs
- Open Data Engineer (Remote) jobs
- Open Senior Data Analyst (Bangkok Based, relocation provided) jobs
- Open Director, Data Engineering jobs
- Open Staff Data Scientist jobs
- Open Lead Data Analyst jobs
- Open Marketing Data Analyst jobs
- Open Junior Data Engineer jobs
- Open Data Manager jobs
- Open Principal Data Scientist jobs
- Open Product Data Analyst jobs
- Open Big Data Engineer jobs
- Open Head of Data Science jobs
- Open Computer Vision Engineer jobs
- Open Machine Learning Scientist jobs
- Open BI Analyst jobs
- Open Data Analyst, Partner Development - (Statistics/ML/BI) (Bangkok-based, relocation provided) jobs
- Open Associate Data Analyst- Customer Experience Group | Bangkok-based jobs
- Open Senior Data Analyst, Partner Development - (Statistics/ML/BI) (Bangkok-based, relocation provided) jobs
- Open Senior Data Architect jobs
- Open Data Analyst (Statistics/Python/BI) (Bangkok-based, relocation provided) jobs
- Open Sr Data Engineer jobs
- Open MLOps Engineer jobs
- Open Excel-related jobs
- Open Consulting-related jobs
- Open Business Intelligence-related jobs
- Open APIs-related jobs
- Open Hadoop-related jobs
- Open Data visualization-related jobs
- Open Data management-related jobs
- Open Data quality-related jobs
- Open Finance-related jobs
- Open Privacy-related jobs
- Open ML models-related jobs
- Open Airflow-related jobs
- Open Snowflake-related jobs
- Open Scala-related jobs
- Open Kafka-related jobs
- Open Deep Learning-related jobs
- Open Data warehouse-related jobs
- Open PhD-related jobs
- Open Git-related jobs
- Open Streaming-related jobs
- Open DevOps-related jobs
- Open NoSQL-related jobs
- Open Docker-related jobs
- Open Kubernetes-related jobs
- Open CI/CD-related jobs