Principal Software Engineer (Big Data Architect)
Pune, India
Mastercard
Wir verbinden und fördern eine integrative, digitale Wirtschaft, von der Menschen, Unternehmen und Regierungen weltweit profitieren, indem wir Transaktionen sicher, einfach und zugänglich machen.Our Purpose
We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results.
Title and Summary
Principal Software Engineer (Big Data Architect)In this role you will primarily focus on the data architecture of Commercial Solutions group. You will lead the design, implementation, and management of Commercial data platform. Work closely with the leadership to form an opinion on choice of tools, technologies, architecture and execute the overall data strategy. You will be responsible for data modelling, database design, data warehousing, and big data technologies, establishing the path to cloud for the entire data platform. Guide and mentor teams on right engineering principals.Responsibilities:
• Develop and implement a comprehensive data strategy that aligns with the organization's goals.
• Define data architecture standards, principles, and guidelines.
• Responsible for defining and designing the data warehouse, data lakes and establish the data integration strategy.
• Establish data governance policies and procedures and implement data quality assurance processes.
• You will be hands on and work closely to guide a team of Data Engineers in the associated data maintenance, integrations, enhancements, loads and transformation processes for the organization.
• Own and drive the evaluation of data management technologies and lead the implementation with a high bar of performance, scalability, and availability standards.
• Design and optimize the systems for speed, efficiency, and reliability.
• Ensure data security and privacy compliance with relevant regulations and standards.
• Implement security measures to protect sensitive data from breaches and unauthorized access.
• Provide technical guidance and mentorship to junior data engineers and developers.
• Strong data engineering experience in an agile production environment.
Requirements:
• Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale.
• Experience leading the design and implementation of complex features.
• Experience leading a large project and working with other data and software engineers.
• Experience working in enterprise databases and ensure follow industry best practices around data privacy.
• Expertise in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms.
• Experience in Java/.net, Scala, or Python technologies and deliver analytics involving all phases like data ingestion, feature engineering, modelling, tuning, evaluating, monitoring, and presenting.
• Experience in anonymizing data, data product development, analytical models, and AI governance.
• Experience with SQL, Multi-threading, Message Queuing & Distributed Systems.
• Effective communication and collaboration skills to work with both technical and non-technical stakeholders.
• Flexible to work with global offices across several time zones.
• Outstanding problem-solving skills and the ability to navigate complex data challenges. #A12
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
Abide by Mastercard’s security policies and practices;
Ensure the confidentiality and integrity of the information being accessed;
Report any suspected information security violation or breach, and
Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile AI governance Airflow Architecture Big Data Data governance Data management Data quality Data strategy Data warehouse Data Warehousing Distributed Systems Engineering Feature engineering Hadoop Java Machine Learning NiFi Pipelines Privacy Python Scala Security Spark SQL
Perks/benefits: Career development Flex hours Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Research Scientist jobs
- Open Data Science Manager jobs
- Open Junior Data Analyst jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data Scientist II jobs
- Open BI Analyst jobs
- Open Business Intelligence Engineer jobs
- Open Sr. Data Scientist jobs
- Open Data Science Intern jobs
- Open Senior Business Intelligence Analyst jobs
- Open Software Engineer, Machine Learning jobs
- Open Lead Data Analyst jobs
- Open Azure Data Engineer jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Manager, Data Engineering jobs
- Open Marketing Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Engineer III jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Data Analyst II jobs
- Open Product Data Analyst jobs
- Open Privacy-related jobs
- Open Power BI-related jobs
- Open Tableau-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open LLMs-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open Consulting-related jobs
- Open Business Intelligence-related jobs
- Open Generative AI-related jobs
- Open NLP-related jobs
- Open CI/CD-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open DevOps-related jobs
- Open Git-related jobs
- Open Docker-related jobs
- Open Hadoop-related jobs