India: New Locations - Data Engineer

Join Netguru Talent Marketplace, a proven partner for tech-minded freelancers and experts. Thanks to us, you will have access to various project-based opportunities and can collaborate with different companies and industries. As a result, you will not only gain more experience but also develop a variety of skills you didn’t even know you had. Work the way you like, on your terms, with no strings attached.

Over the past ten years, Netguru has changed the way people bank, listen to music, learn languages, and rent bicycles. Some of our clients include Fortune 500 companies and startups like Shine, Countr, Petro Niche, and more. Netguru works with the largest brands in the world, such as Volkswagen, IKEA, and Keller Williams.

Our team of 650+ allows us to deliver well-designed and optimized custom mobile app development solutions for both iOS and Android mobile platforms, in turn, increasing the productivity of a business enterprise. The main reason behind custom mobile apps is that they not only help business owners transform their unique ideas into reality, but also help them deliver personalized UX.

Joining Netguru's project means:

• Working with the Data Engineering and Machine Learning team to build custom data pipelines.
• Working with external clients, teams, data owners, and solution architects to build data flows in a reliable way.
• Building transformations, scripts, and migrations to multiple specifications and standards.
• Data-driven mindset - our clients require PoCs, data exploration/normalization, and expertise.
• Monitoring data flows and making continuous improvements to data pipelines.

Requirements

Apply if you:
• Are advanced in Python programming language (understanding: iterators, generators, exceptions, OOP, popular libraries for data engineering).
• Have advanced SQL knowledge.
• Have practical knowledge of DevOps t.j. CI, CD, terraform, observability.
• Have experience with Apache Spark / AWS Glue, or similar solutions.
• Have experience with ETL (Airflow) or other data processing automation approaches.
• Have experience with Snowflake.
• Have a very good command of written and spoken English (B2+). Polish is not required.

We'll be happy to see that you have:

• Experience with AWS Redshift or GCP BigQuery.
• Experience with coding in Scala.
• Have hands-on experience with Hadoop technologies or equivalent in the cloud environment.
• Experience optimizing data storage in HDFS/Parquet/Avro.
• Experience with cloud technologies (AWS, GCP, Azure or other).
• Worked with data (ideally TB+).
• Can debug complex data infrastructures.

Benefits

• 100-percent remote work.
• Work with an experienced team of developers and continuously develop your hard and soft skills.
• A mentor who will assist you during your first days.
• Dev-friendly processes such as Continuous Integration, Continuous Delivery, Code Review, and bug bashes.
• Collaboration on challenging products (FinTech, B2B software, E-commerce, and more).