Staff Data Engineer

Company Description

Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you join a culture of purpose and belonging – where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world – helping unlock financial access to enable the future of money movement.

Join Visa: A Network Working for Everyone.

Job Description

Our People Technology team is looking for a Data engineer in Bangalore, for “PaaS, Digitalization & Data Platform”.  

The “PaaS, Digitalization & Data Platform” team is a key enabling function in positioning Visa as the world leader of talent and employee experiences. This team’s role is to deep-dive into the Core HR operations and finds ways to inject speed and robustness into our processes. This team helps with data democratization and developing iterative and rapid ways of doing things with focus on shortening HR processes turnaround time from days to minutes.  Additionally, this team extends the HR Data Hub service to a full-fledged People Technology PaaS (Platform as a Service) to enable our vendors to plug-and-play into our eco-system consisting of event management, activity management, API gateway and data management.
Are you skilled at turning hard numbers into compelling stories and useful strategic insights? Do you solve complex data challenges with creative flair? Put those skills to work answering strategic questions for one of the world's most respected and innovative payments companies.

As a Data Engineer, you will be responsible for helping to blueprint and deliver modelled attributes, data assets, and self-serve workflows that solve clients' business objectives. You will get the chance to leverage your business acumen and technical knowledge of big data and data mining techniques. Based on deep understanding and knowledge of big-data engineering techniques, you will develop and maintain data and tools to enable data scientists to draw fact based insights and build models.

The position will be based at Visa's India office in Bengaluru, Karnataka.

Responsibilities

• Translate business requirements and source system understanding into technical solutions using Big Data & Java etc.
• Work with solution teams and business partners directly to seek clarity on requirements.
• Design, build and launch extremely efficient & reliable data pipelines to move data (both large and small amounts) in/out of our Hadoop Data Lake.
• Define solutions in terms of components, modules, and algorithms.
• Create technical documentation and procedures for installation and maintenance.  
• Write Unit Tests covering known use cases using appropriate tools
• Integrate test frameworks in development process
• Refactor existing solutions to make it reusable and scalable
• Build and maintain robust data engineering process to develop and implement self-serve data.
• Perform other tasks on R&D, data governance, system infrastructure, and other cross team functions, on an as-needed basis
• Find opportunities to create, automate and scale repeatable analyses or build self-service tools for business users.
• Come up with Coding and Design best practices
• Assist in scoping and designing analytic data assets.
• Collaborating with and/or lead cross functional teams, build, and launch applications and data platforms at scale.
• Thrive in self-motivated internal-innovation driven environment
• Adapting fast to new application knowledge and changes.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office two days a week, Tuesdays and Wednesdays with a general guidepost of being in the office 50% of the time based on business needs.

Qualifications

• Bachelors in Computer Science, or Information Systems or related field
• 8-12 years of experience in data technologies and applications development
• 2+ years of experience in Hadoop using Core Java Programming, Spark, Kafka, Hive, Pig scripts, Sqoop on Linux/Unix environment
• Expertise in ETL tools like Nifi, Pyspark, DB Scripts, Mongo DB.
• Expertise in job schedulers Airflow, Grafana
• Agile development experience.
• Expertise in Object Oriented Programming Language - Java/ Python
• Strong algorithms and data structures
• Strong knowledge of database concepts and UNIX/LINUX
• Expert level SQL skills for data manipulation (DML) and validation (DB2)
• Experience using version control and bug tracking tools, along with CI/CD experience in Jenkins or Azure devops.
• Result oriented with strong analytical and problem solving skills
• Work independently with minimal supervision
• Comfortable learning new technologies quickly
• Excellent team player, strong interpersonal and communication skills

Additional Information

Visa has adopted a COVID-19 vaccination policy. As a condition of employment, all employees based in the country where this job is located are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.