Lead Data Engineer

ATB Ventures: Putting the future in the hands of our customers

An extension of ATB Financial, ATB Ventures was started back in 2018, knowing that the convergence of data with powerful emerging technologies such as blockchain, artificial intelligence, and machine learning would pave the way for major disruption and value creation that exceeded the digital transformation of the past 20 years.

Today, ATB Ventures is a team of engineers, data scientists, product managers, and business operators who having been building emerging solutions from scratch - including Open ATB> Open AI, Open Data, API Sandbox, Oliu (Self-Sovereign Digital ID platform), Proof (Digital credential wallet) and more.

ATB Ventures is currently growing its data and AI practice and is looking for a Data Engineer to join the team. In this role, you’ll be responsible for working with product and delivery teams to help them in determining their data needs and finding innovative ways to build elegant and scalable data products that support different types of analytics within ATB Ventures. You will continuously develop your expertise in data management. You’ll be challenged to set your own goals, priorities and pace of delivery while contributing to the overall success of the team.

Summary of key responsibilities | What you will be responsible for day-to-day…

• Build massive reservoirs for big data.
• Develop, construct, test and maintain architectures such as databases and large-scale data processing systems.
• Create and maintain optimal data pipeline architecture.
• Develop data set processes for data modeling, mining and production.
• Define data requirements, test data needs for product/delivery teams.
• Create custom software components (e.g. specialized UDFs) and analytics applications.
• Implement and maintain DataOps processes and data processing best practices
• Implement and maintain CI/CD pipelines for continuous integration and continuous delivery of data pipelines and data products.
• Recommend ways to improve data reliability, efficiency and quality.
• Employ a variety of languages and tools (e.g. scripting languages) to marry systems together.
• Collaborate with data architects, data scientists and product team members on project goals.
• Research and implement new tools and techniques for team use.
• Improve the process for team members to access and understand customer data.

Requirements

Helpful skills & experience | What we're looking for in the ideal candidate...

• Minimum a BSc in computer science or engineering, with 4+ years experience as a data engineer
• Demonstrated proficiency in at least one major language (e.g. Python, Ruby, etc). Bonus points if you also have experience with PySpark, Java, R and MATLAB
• Experience with building & maintaining ETL/ELT pipelines in Data Warehouses & Data Lakes
• Experience with integration of real-time and streaming data
• Experience with Database systems (both SQL & NoSQL), such as MySQL, PostgreSQL, Cassandra and MongoDB
• Experience with designing & building CI/CD pipelines
• Experience with containerization & Kubernetes technologies (Preferably on GCP)
• Experience with working in an Agile/Scrum environment

Nice-to-haves:

• GCP Professional Data Engineering Certification, with experience in building Data APIs
• Experience with distributed systems and distributed processing of large data sets using Apache Hadoop and Apache Spark is desirable
• Bonus points if you’ve built a startup, can demonstrate your unique contributions to open source projects and/or have experience with human interface/human UX

Benefits

Perks & Benefits | What can ATB Ventures offer you?

Create the future: ATB Ventures offers a unique opportunity for creatives, innovators, and engineers alike to invent - and reinvent - how we experience technology. It provides the ability to work on a talented, anti-disciplinary team that rapidly experiments with ideas, products and technologies whilst being immersed in a culture that brings the best of both the banking and start-up worlds. Imagine excellent benefits, banking perks, opportunities for career advancement, and being at the forefront of the future – now you’re talking about a career with an organization and team that enables you to grow.

As an award-winning employer-of-choice – we have the best of the best working not only for Albertans, but the world.