Senior Data Engineer

Eyeline StudiosAt Eyeline, Scanline VFX's virtual production division, we want to provide you with a solid foundation where you can be a part of an innovative team of brilliant researchers, developers and virtual storytellers. Learn more.
The Senior Data Engineer role is centered around implementing scalable big data analytics systems. This includes the acquisition and processing of raw data at scale through diverse methods like scripting, API calls, web scraping, and SQL querying. The position involves designing a robust data handling framework and constructing data warehouses that prioritize data quality, scalability, and availability. 
The engineer will be responsible for experimenting with and refining data models to extract insights and intelligence, managing the entire data lifecycle, and formulating data retention policies to optimize model reporting. Responsibilities extend to the development of database architecture, the creation of metadata and repositories, and the formulation of warehousing blueprints, taking into account both hardware and software platforms for system integration. 
This role demands translating complex business requirements into sustainable long-term architecture solutions, crafting dimensional database schemas, and ensuring data is reusable across different analyses. It includes the management of data sheering to eliminate obsolete or redundant data, reviewing data and object models, and enhancing the metadata repository to facilitate more efficient data access and management. Candidates are expected to have a computer science or engineering degree and possess over three years of experience in data engineering, showcasing a deep understanding of cloud platforms, data flow management, and the ability to deploy scalable data models in a fast-paced environment.

Key Responsibilities

• Design, construct, install, and maintain large-scale processing systems and other infrastructures.
• Handle millions of events per second, ensuring smooth data flow and efficient analytics.
• Develop and maintain data architectures, such as databases and large-scale processing systems, data analytics, and other data functionalities.
• Collaborate with all departments within the business including production, finance, infrastructure, R&D, and more to gather requirements and optimize data solutions.
• Lead and deploy projects on major cloud platforms (GCP, AWS, Azure) with best practices in mind.
• Stay updated with the latest open source tools and platforms in data analytics, ensuring our studio leverages the best technology for our needs.
• Design and implement complex, scalable data models to support studio operations.
• Integrate data from various sources, ensuring data integrity and speed.
• Proactively identify opportunities to optimize and refine data workflows and processing.
• Collaborate cross-functionally to ensure seamless data integration into various workflows and departments.

Minimum Qualifications

• 2-3 years of experience in a Data Engineering role, with a track record of leading significant data projects.
• Strong expertise in deploying projects on hybrid on-prem-cloud platforms.
• Demonstrable experience in handling massive data flows, ideally millions of events per second.
• Deep understanding of the open source data analytics tool landscape.
• Proficiency in at least one programming language, ideally Python.
• Familiarity with distributed systems like Hadoop, Spark, Kafka, and similar platforms.
• Knowledge of database structures, theories, principles, and practices.
• Ability to craft and execute SQL, NoSQL, and graph-based queries.
• Strong analytical and problem-solving skills.

Preferred Qualifications

• Familiarity with VFX and/or Animation workflows and business will be a significant advantage.

About UsScanline VFX is an award-winning leader in the visual effects industry with 7 studios worldwide, including London, Los Angeles, Montreal, Munich, Seoul, Stuttgart, and Vancouver. Since our beginning in 1989, we strive to set the highest standard of quality in everything we do. Through innovation, we generate solutions for our clients and raise the bar — both within our workplace and throughout our industry.
We look for explorers, people who are willing to go to new places and are open to testing, learning and iterating as they go. We believe great ideas come from everyone, so we actively encourage team members to ask questions and present their ideas.
Powered by NetflixNetflix’s investment in our pipeline, infrastructure, and workforce allows us to continue to push the boundaries of what is possible in visual effects. In addition to working on projects for Netflix, we continue to work with a variety of long-standing and new clients.
Come as you areWe are committed to ensuring fair and equal treatment of your application. When you apply for a role with us, you will receive consideration based solely on your qualifications.
We will only consider applicants based in British Columbia, or those willing to relocate.