Senior Data Engineer

Job Summary:

Square Enix has a cloud-based platform named Single Gamer View (SGV), which provides our Analytics & Insights team and other groups across the business with a single data lake pooling game telemetry, sales and marketing data, web analytics and other information. The Senior Data Engineer will work alongside other data engineers in the Data Engineering team who are responsible for maintaining and further developing this platform. Duties include:

• Defining and architecting the SGV platform, which requires a deep understanding of GCP cloud services to identify the most appropriate tool for the job and integrate them into a cohesive platform.
• Optimising, refining and enhancing the data acquisition pipelines.
• Working with client teams to ensure robust capture of high-quality data.
• Supporting data analysts and other users of the data via training and technical assistance.
• Working in partnership with the Data Science division of Analytics & Insights to advise their efforts, architecture, and deployment processes. Requiring the sharing of knowledge and experience of best practices, principles, and processes.
• Sharing industry best practices and otherwise encouraging professional development for others in the Data Engineering team.
• Leading the Cyber Security effort to ensure that all Data Engineering codebases meet the expectations of the Cyber Security team and representing the Data Engineering team in the “Secure Code Champions” initiative run by Cyber Security.

This position requires a driven and talented person that can help the team progress.

Requirements

Key Deliverables:

• Support other members of the Data Engineering team and function within the Online Development department.
• Ensure the Data Engineering team deliver on requests from client teams to agreed specification and timelines.

• Ensure open and regular communication with other stakeholders regarding the status of their projects.

• Work to ensure Data Engineering team is capable of delivering against responsibilities. Maintain a learning culture within the team to enable individual team members to continue to grow professionally and to develop their skills, with methods such as:
  • Pairing with the other Engineers to improve skills
  • Undertaking code reviews
  • Presenting of newly developed processes
  • Architecture & design sessions
• Work with data sources to ensure the data they supply is robust and of high quality.
• Provide data access and querying support to users both within the team and across the business.
• Have a good understanding of the scope, potential and limitations of the datasets maintained by the Data Engineering team, remaining alert to any opportunity to further employ our data to benefit the business.
• To always represent the team professionally – both internally and externally.

Key Stakeholders:

Senior Director Digital Channels, Director of Analytics & Insight

Knowledge & Experience

Essential:

• Experience architecting and implementing data processing solutions in a cloud environment
• Excellent programming skills in Java (11 preferable) & Python are both essential
• Experience with testing frameworks, Junit, Mockito, etc.
• High-level of professional experience with cloud-based data engineering platforms, particularly Google Cloud Platform (DataFlow, BigQuery, PubSub, GCS).
• Expertise with lambda architecture and other approaches to capture and processing of data at scale to provide real-time analytics capability.
• Comfortable familiarity working with large data sets.
• Expert SQL skills.
• Excellent problem solving & analytical skills.
• Experience modelling ETLs using Apache Beam.
• Experience writing near real-time ETLs.
• Experience with multiple build tools, preferably gradle.
• Familiarity with OSX or Linux environment (shell scripting, basic system administration etc).
• Experience with managing a code base and using source control/collaboration tools such as GitHub, Bitbucket or GitLab.
• Familiarity with collaboration and communication tools such as JIRA, Confluence, Slack, etc.

Desirable:

• BSc or higher level degree in Computer Science, STEM subject or a similar field of study.
• Experience with a variety of systems with aggregation frame works such as Mongo and Elastic Search.
• Experience with DAG-based workflow management systems, ideally AirFlow.
• Experience with Hadoop technologies.
• Experience writing ETLs in SPARK.
• Knowledge of functional programming languages, such as Scala, Kotlin, etc

Competencies, Skills & Attributes

Essential:

• Ability to quickly learn and employ new technologies and methodologies.
  
• Highly numerate
• Strong documentation skills.
• Ability to articulate and present ideas and information with ease and clarity.
• Ability to work on own initiative and as part of team.

Other:

• Strong interest in technology.
• Ambition to drive self-development
• Excellent attention to detail.
• Ability to work under pressure and to deadlines.
• Follower of industry trends and developments.

Our goal at Square Enix is to hire, retain, develop and promote the best talent, regardless of age, gender, race, religious, belief, sexual orientation or physical ability.

Our pledge to D&I

At Square Enix we believe in the importance of being a diverse and global company, and we stand firmly together against any forms of injustice, intolerance, harassment or discrimination. In our effort to create a truly diverse workforce, we pledge to continue to raise awareness in every step of the employee experience, from recruitment to promotions to ensure equal opportunities for all. One of our goals is to champion diversity in games and at work and work together to inspire real change.

Learning and education around D&I will be a key element for us to continue to grow as an organization. With unconscious bias training, D&I workshops and a variety of initiatives to give our employees the opportunity to be heard and be part of that change to achieve real equality. We need all our efforts to continue to build our culture of inclusion and equality.

We are also proud to partner with UKIE's Raise the Game pledge, BAME in Games and Women in Games, to name a few.

Covid-19 remote working

Square Enix are committed to keeping our employees safe. We are listening closely to government guidelines, and this role will be based remotely until the company sees fit to return to the office. This role will be based in our Blackfriars Studio in London, upon return.