Cloud Big Data Engineer

Company Description

Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you join a culture of purpose and belonging – where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world – helping unlock financial access to enable the future of money movement.

Join Visa: A Network Working for Everyone.

Job Description

Cybersecurity is at the beating heart of our culture. Our diligence and expertise is what makes us the undisputed leader in electronic payments.  We’ve made it our priority to create a top-tier Security Architecture team, poised to defend us against any potential cyber threats.  Cybersecurity Architecture team is looking for a Data Engineer with Hadoop admin experience. Candidate will be a part of the Visa Security Analytics Engineering team and involved with administering Hadoop-ecosystem and Data Engineering activities.

The successful candidate will be working on cutting-edge technologies to perform statistical profiling, inference, classification, clustering, and predictive analysis. As a key member of the Data Engineering team, you will be working on large datasets of Security Data and implement Data mining, Data parsing contributing to data availability building machine learning models to help derive new insights to defend against cyber-attacks.

You will be working with world-class operation teams including Cyber Defense team and Data Science team to create awesome analytics for security and other business units. You'll need to have excellent communication and cross-group collaboration skills, be able to make forward progress despite ambiguous circumstances, be a self-starter, a quick learner of new technologies and have experience in Data engineering to maintain Data Quality and Integrity. 

What You Will Do as Sr. Data Analyst:

• Experience  working with opensource Apache  Hadoop eco-system , which includes – installations , service-setup and providing support .
• Prior experience building and operating large-scale data pipelines and experience in working with opensource versions / upgrades .
• Strong computer science fundamentals in design, data structures, and algorithms and experience in building api's using java or python.
• Experience in working with opensource Hadoop technologies - kafka , Spark , Airflow ,oozie etc
• Experience with opensource technologies like Druid , Superset , Syslog-ng and expertise with Apache opensource code , packages and compilation process.
• Experience migrating on prem datalake to cloud on AWS or any including Databricks / Snowflake.
• Experience with CI/CD 
• Experience working in the IT security domain and expertise providing solutions/mitigations for common security vulnerabilities & threats in Java code . 
• Experience with complete Security related vulnerabilities and remediation process 
• Interact with CyberDefense and Security Engineering units to define requirements/modifications and use case to utilize in designing appropriate solutions.

Position Location - Foster City, CA.

Flex Work Arrangement - Hybrid Position - This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office two days a week, Tuesdays and Wednesdays with a general guidepost of being in the office 50% of the time based on business needs.

Qualifications

Basic Qualifications

2 or more years of work experience with a Bachelor’s Degree or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)

Preferred Qualifications

o 3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work
experience with an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)
o Minimum 2 years’ experience in application development with Java, Spring and big data
technologies (Hadoop, Python, Scala, NiFi, Kafka, Spark, Hive etc.) tools
o Experience in code development and code security vulnerabilities
o Experience in API Development using SOAP or REST, JSON and XML
o Experience with GIT/Stash, Maven and Jenkins
o Experience in SQL and/or PL/SQL
o Experience in Windows server platforms and Unix or Linux platforms
o Experience with SOAPUI or Postman preferred
o Ability to solve complex software development/design issues
o Ability to write clean, coherent code following established coding guidelines
o Experience developing as part of Agile/Scrum team is preferred
o Passionate about delivering zero defect code that meet or exceed the proposed defect SLA and
have high sense of accountability for quality and timeliness of deliverables
o Ability to deliver on multiple projects and manage priorities based on changing directions
o Demonstrated ability to lead and navigate through ambiguity

Additional Information

Visa has adopted a COVID-19 vaccination policy to safeguard the health and well-being of our employees and visitors. As a condition of employment, all employees based in the U.S. are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.

Work Hours: Varies upon the needs of the department.

Travel Requirements: This position requires travel 5-10% of the time.

Mental/Physical Requirements: This position will be performed in an office setting.  The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer.  Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.  Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law, including the requirements of Article 49 of the San Francisco Police Code.