Data Pipeline Engineer

Bengaluru, India

Applications have closed

Palo Alto Networks

Implement Zero Trust, Secure your Network, Cloud workloads, Hybrid Workforce, Leverage Threat Intelligence & Security Consulting. Cybersecurity Services & Education for CISO’s, Head of Infrastructure, Network Security Engineers, Cloud...

View all jobs at Palo Alto Networks

Company Description

Our Mission

At Palo Alto Networks® everything starts and ends with our mission:

Being the cybersecurity partner of choice, protecting our digital way of life.

We have the vision of a world where each day is safer and more secure than the one before. These aren’t easy goals to accomplish – but we’re not here for easy. We’re here for better. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking for innovators who are as committed to shaping the future of cybersecurity as we are.

We’re changing the nature of work. Palo Alto Networks is evolving to meet the needs of our employees now and in the future through FLEXWORK, our approach to how we work. From benefits to learning, location to leadership, we’ve rethought and recreated every aspect of the employee experience at Palo Alto Networks.  And because it FLEXes around each individual employee based on their individual choices, employees are empowered to push boundaries and help us all evolve, together. 

Job Description

Your Career

  • As a Data Pipeline Engineer, you will be an integral member of our Artificial Intelligence & Analytics team responsible for design and development
  • Help build the technical foundations of our Data Ingestion and Engineering team
  • Be constantly challenged by tough engineering and design tasks
  • Build in-bound and out-bound integration from various applications with Enterprise data-lake
  • Supports Big Data and batch/real time analytical solutions leveraging transformational technologies
  • Enable users to perform CRUD operation on enterprise data lake using REST API services
  • Build data profiling and ETL jobs using heterogeneous sources

Our office-based roles in India work from their respective location at least four days per week. Our team in India has grown significantly over the last few years and working together in person helps us all build deeper relationships and trust that accelerate our work, allow us to feel safer in taking risks and being disruptive, and increase the speed to work through issues and ideas informally. The days of the week are decided at a team level, and the hours remain flexible within reason.

You Impact

  • Partner with data analysts, product owners and data scientists, to better understand requirements, finding bottlenecks, resolutions, etc.
  • Design and develop different architectural models for our scalable data processing and profiling and create certified feature sets to be consumed by our data science team
  • Create complex integrations, between various cloud platforms and Google BigQuery, Salesforce etc.
  • You will also have opportunity to work closely with our data science team and work on various business critical predictive use-cases


​​​​​​Your Experience 

  • 3+ year of experience with the Cloud ecosystem and Big Data technologies (Google Cloud, AWS or Azure)
  • Strong knowledge of JAVA/Python and SQL - good understanding of data structure and algorithms
  • Experience in working with REST/SOAP API services
  • Experience in big data open source products like Apache Kafka, Confluent Centralized Schema Registry is plus
  • Understanding of data governance and data profiling concepts is plus
  • Ability to work in a fast-paced environment and manage multiple simultaneous priorities
  • Effective problem solving and analytical skills

Additional Information

The Team

As part of the Agentless  team, you will be responsible for building products that protect data, workloads, and infrastructure for some of the largest enterprise customers in the world. We help the customers in their transitional journey to the cloud by ensuring they have the best in class protection. The cloud market has been growing at a rapid rate for the last few years. As more and more enterprises use the public cloud, there is an insatiable demand for securing workloads in the public cloud. With our recent acquisition of Prisma Public Cloud, formerly RedLock™ and making Palo Alto Networks the reigning market leader.

Our Commitment

We’re trailblazers that dream big, take risks, and challenge cybersecurity’s status quo. It’s simple: we can’t accomplish our mission without diverse teams innovating, together.

We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at

Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

All your information will be kept confidential according to EEO guidelines.

Covid-19 Vaccination Information for Palo Alto Networks Jobs

  • Vaccine requirements and disclosure obligations vary by country.
  • Unless applicable law requires otherwise, you must be vaccinated for COVID or qualify for a reasonable accommodation if:
    • The job requires accessing a company worksite
    • The job requires in-person customer contact and the customer has implemented such requirements
    • You choose to access a Palo Alto Networks worksite
  • If you have questions about the vaccine requirements of this particular position based on your location or job requirements, please inquire with the recruiter.

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  2  0  0
Category: Engineering Jobs

Tags: APIs AWS Azure Big Data BigQuery Data governance Engineering ETL GCP Google Cloud Java Kafka Open Source Python REST API Salesforce SQL

Perks/benefits: Career development Flex hours Medical leave

Regions: Asia/Pacific North America
Countries: India United States

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.