Lead Data Engineer ( pyspark+AWS+Redshift)

Location: Bengaluru, Delhi, Gurgaon, Kolkata,Chennai,Hyderabad,Pune,Indore,Jaipur and Ahmadabad,None,None

About Material

Material is a global strategy, insights, design, and technology partner to companies striving for true customer centricity and ongoing relevance in a digital first, customer-led world. By leveraging proprietary, science-based tools that enable human understanding, we inform and create customer-centric business models and experiences + deploy measurement systems – to build transformational relationships between businesses and the people they serve.

About Srijan

Srijan is a global engineering firm that builds transformative digital paths to better futures for Fortune 500 enterprises to nonprofits all over the world. Srijan brings advanced engineering capabilities and agile practices to some of the biggest names across FMCG, Aviation, Telecom, Technology, and others. We help businesses embrace the digital future with cloud, data, API and platform centric technologies and adapt to changing business models and market demands. Srijan leads in Drupal with 350+ Drupal engineers, 80+ Acquia certifications. Srijan is also a Drupal Enterprise Partner & Diamond Certified

 

What you will get:

1. Competitive Salaries with flexi benefits 
2. Group Mediclaim Insurance and Personal Accidental Policy
3. 30+ Paid Leaves in a year 
4. Learning and Development of quarterly budgets for certification

 RequirementExperience of 3-6 years, predominantly on Data Architect, Data Warehousing / Data Lake on AWS, Python, Spark, Redshift

• Proven hands-on experience with spark and python is a must.
• 2+ plus years of developing applications using python, Data Warehousing / Data Lake,  Consumer APIs, Real-time Data pipelines/Streaming
• Cloud Native development is compulsory (AWS)

● experience working with Integration Platform, Datawarehouse, Data lake, and ETL/ELT Loads.
● Must be strong in coding either Java, Scala or Python worked on Integration between different sources and target systems like RDBMS(Salesforce, BB CRM, Oracle, Postgres, MySQL, SQL Server)
● Extract Data from Source Systems using APIs, Webservices, or bin log files using AWS Glue using pyspark or spark with scala.
● Must have experience in retrieving data from REST and SOAP API● Experience with AWS Redshift. ● Experience with Kafka streaming. Apply to this job