Senior Data Engineer (PySpark, AWS, Ab Initio)
United Kingdom, London
Applications have closed
PlayStation Global
Erkunde die neue Generation von PlayStation 4- und PS5-Konsolen – erlebe immersives Gaming mit Tausenden Spiele-Hits aus allen Genres, die die Regeln für das, was eine PlayStation-Konsole kann, neu schreiben.Why PlayStation?
PlayStation isn’t just the Best Place to Play — it’s also the Best Place to Work. Today, we’re recognized as a global leader in entertainment producing The PlayStation family of products and services including PlayStation®5, PlayStation®4, PlayStation®VR, PlayStation®Plus, PlayStation™Now, acclaimed PlayStation software titles from PlayStation Studios, and more.
PlayStation also strives to create an inclusive environment that empowers employees and embraces diversity. We welcome and encourage everyone who has a passion and curiosity for innovation, technology, and play to explore our open positions and join our growing global team.
The PlayStation brand falls under Sony Interactive Entertainment, a wholly-owned subsidiary of Sony Corporation.
Role overview:
As a Senior Data Engineer, you will be technically mentoring Data Engineers and will play a thought leadership role in our team – the team will look to you for advice on data architectures and business issues facing them.
In this role, you will build data processing platforms which power the Data Science and Core Product teams to answer questions with data, using software engineering best practices, data management fundamentals, and recent advances in distributed systems (Big Data
Technologies).
You will work with passionate scientists, business intelligence engineers, software development engineers, product managers and business analysts, to deliver a comprehensive set of stable and performant data architectures to build data stacks complementing software that powers the organization.
You are an expert at designing, implementing, and operating stable, scalable, low-cost solutions to flow data from production systems into other systems. The role requires someone who loves data, understands enterprise information systems, has a strong business sense, and can mentor a team to put these skills into action.
The successful candidate will be eager to learn; building highly available, scalable applications using hybrid set of tools and technologies like Spark, Airflow, Ab Initio, EKS, Lambda and Snowflake.
What you’ll be doing:
- Hands-on participation in Engineering tasks such as coding, peer reviews, building POCs
- Lead, influence, and be a contributor across our entire technology team while acting as an area specialist for your team
- Partner closely with other tech leads to design and implement org wise solutions
- Implement all the necessary infrastructures which allow self-healing and observable monitoring of data ingestion, and consumption
- Define, develop and maintain artifacts like technical design or user documentation and look for continuous improvement in software and development process within agile
- Proactive enhancement and support of the Data architecture to minimize technical debt and maximize agility
- Resolve problems and roadblocks as they occur with help from peers. Follow through on details and drive issues to closure
- Communicate and work effectively with geographically distributed multi-functional teams.
- Drive problem and conflict resolution for team
- Share technology takeaways and POCs across engineering community in organization
- Take on technical ownership of a work stream, be the subject matter expert and managing risks and issues
- Performance tuning of code and review of fellow developer’s code to confirm adherence to best practices
- Mentoring of more junior members of the team
- Work with Project Managers and Business Analysts to ensure the timely delivery of project deliverables that meet requirements
- Actively communicating and collaborating with stakeholders across geographies.
What we are looking for:
- Bachelor’s degree in computer science or related technical field or equivalent related professional experience
- 5+ years of proven experience in Big Data / distributed compute projects
- Equivalent years' experience in designing and crafting high volume data processing applications
- Extensive experience of development of distributed systems using PySpark.
- Experience building data pipelines using cloud services (AWS preferable)
- Experience in leading and mentoring junior engineers.
- Good understanding of data modelling, schema design patterns and modern data access patterns (including API, stream, data lake) in cloud (AWS preferable)
- Knowledge around Distributed Systems Architecture and orchestration (Airflow preferable)
- Team uses both PySpark and Ab Initio to build high performance ETL solutions hence the ideal candidate should be open to learn and excel in the complete tech stack.
- Able to justify technology choices to technical and non-technical observers making well-defined choices
- Highly proficient in SQL and knowledgeable about data warehousing concepts.
Benefits:
- Discretionary bonus opportunity
- Private Medical Insurance
- Dental Scheme
- London Allowance (if applicable)
- 25 days holiday per year
- On Site Gym
- Subsidised Café
- Free soft drinks
- On site bar
- Access to cycle garage and showers
Equal Opportunity Statement:
Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy or maternity, trade union membership or membership in any other legally protected category.
We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow APIs AWS Big Data Business Intelligence Computer Science Data management Data pipelines Data Warehousing Distributed Systems Engineering ETL Excel Lambda Pipelines PySpark Snowflake Spark SQL VR
Perks/benefits: Fitness / gym Health care Insurance
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs