Manager, Data Engineering
Bengaluru, India
Visa
Das digitale und mobile Zahlungsnetzwerk von Visa steht an der Spitze der neuen Zahlungstechnologien für die neue Zahlung, elektronische und kontaktlose Zahlung, die die Welt des Geldes bildenCompany Description
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.
Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.
Job Description
To ensure that Visa’s payment technology is truly available to everyone, everywhere requires the success of our key bank or merchant partners and internal business units. The Global Data Science group supports these partners by using our extraordinarily rich data set that spans more than 3 billion cards globally and captures more than 100 billion transactions in a single year. Our focus lies on building creative solutions that have an immediate impact on the business of our highly analytical partners. We work in complementary teams comprising members from Data Science and various groups at Visa. To support our rapidly growing group, we are looking for data engineers who are equally passionate about the opportunity to use Visa’s rich data to tackle meaningful business problems.
This position will be part of the Global Solution Data Engineering team under the Global Data Office function, responsible for building and maintaining global data assets and data solutions. We are looking for expertise in data warehousing and building large-scale data processing systems by using the latest database technologies. The Staff Data Engineer takes responsibility for building and running data pipelines, designing our local data warehouse and data frameworks, and catering for different data presentation techniques. The position is based at Visa's offices in Bangalore, India.
Essential Functions
• Define, Execute and Manage large scale data pipelines to build data solutions with required scalability and flexibility to support delivery to clients across all regions.
• Strong Data Analytical and Visualization skills along with experience in self-service reporting tools like Tableau or Power BI with KPIs and facilitate Visa Consulting engagements including data exchange
• Should have strong problem-solving capabilities and ability to quickly propose feasible solutions and effectively communicate strategy and risk mitigation approaches to leadership
• Build ETL pipelines in Spark, Python, HIVE that process transaction and account level data and standardize data fields across various data sources
• Responsible for the on-time delivery of dashboards and model scores to clients using the global solutions in the portfolio
• Build and maintain high performing ETL processes, including data quality and testing aligned across technology, internal reporting and other functional teams
• Responsible for the enhancements, data processing and monthly/quarterly deliverables of the products/solutions assigned from the Global solutions portfolio
• Create data dictionaries, setup/monitor data validation alerts and execute periodic jobs like performance dashboards, predictive models scoring for client’s deliverables
• Define and build technical/data documentation and experience with code version control systems (e.g. git). Ensure data accuracy, integrity and consistency
• Find opportunities to create, automate and scale repeatable financial and statistical analysis for Visa Consulting and Analytics
• Collaborate with various business and technical teams across Global regions, ensuring smooth management of solution build and operations
• Strong written, verbal, and interpersonal skills needed to effectively communicate technical insights and recommendations with business customers and leadership team
• Exposure working with Global teams & Fortune 500 companies and possess strong experience working directly in client facing roles
• Exposure to model management and governance practices. Ability to take decisions around model drift to monitor and refine models continuously
• Manage a team of Data engineers, providing the required mentoring and support in building a strong team and deliver as per expectations.
Technical skills:
• Strong experience in creating large scale data engineering pipelines, data-based decision-making and quantitative analysis.
• Experience with SQL for extracting, aggregating and processing big data Pipelines using Hadoop
• Experience with complex, high volume, multi-dimensional data, as well as machine learning models based on unstructured, structured, and streaming datasets
• Strong Experience with Visualization Tools like Tableau, Power BI, D3 and exposure to code version control systems (git)
• Advanced experience in writing and optimizing efficient SQL queries with Python and Hive handling Large Data Sets in Big-Data Environments
• Experience creating/supporting production software/systems and a proven track record of identifying and resolving performance bottlenecks for production systems
• Experience with Unix/Shell or Python scripting and exposure to Scheduling tools like Oozie and Airflow.
• Exposure to deploying large scale ML/AI models built by the data science teams and experience with development of models is a strong plus.
This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.
Qualifications
9+ yrs. work experience with a Bachelor’s Degree or 8+ years of work experience with a Master's or Advanced Degree in an analytical field such as computer science, electronics.
Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, Python, Pandas etc.)
Additional Information
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Big Data Computer Science Consulting D3 Data pipelines Data quality Data warehouse Data Warehousing Engineering ETL Git Hadoop KPIs Machine Learning ML models Oozie Pandas Pipelines Power BI Python Spark SQL Statistics Streaming Tableau Testing
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Research Scientist jobs
- Open Data Science Manager jobs
- Open Data Engineer II jobs
- Open Principal Data Scientist jobs
- Open Business Data Analyst jobs
- Open BI Analyst jobs
- Open Data Scientist II jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Science Intern jobs
- Open Senior Business Intelligence Analyst jobs
- Open Software Engineer, Machine Learning jobs
- Open Junior Data Scientist jobs
- Open Azure Data Engineer jobs
- Open MLOps Engineer jobs
- Open Data Analytics Engineer jobs
- Open Manager, Data Engineering jobs
- Open Marketing Data Analyst jobs
- Open Data Engineer III jobs
- Open Junior Data Engineer jobs
- Open Data Engineering Manager jobs
- Open Data Analyst II jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open LLMs-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Business Intelligence-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Git-related jobs
- Open Hadoop-related jobs
- Open Docker-related jobs