Data Engineer II
Canada (Remote)
Flipp
Discover how Flipp's innovative platform connects retailers, brands, and media partners to create engaging digital shopping experiences. Learn more now!Flipp is a pre-IPO company on a mission to help shoppers provide for their families by making life more affordable by leveraging technology. We work with the largest retailers and manufacturers in the world to help them transform their businesses and connect them with millions of shoppers through our next-generation digital shopping marketplace. Our award-winning Flipp app is used by millions of shoppers every week to make better purchase decisions and to save 20-40% off their bills.
With the recent increase in costs of living, Flipp’s mission has never been more relevant. Flipp’s Shopper Consideration Platform allows retailers and manufacturers to create digital experiences from their savings & deals content. These experiences help Shoppers decide what to buy and where to buy it. Flipp then connects those retailer and manufacturer experiences to millions of shoppers through Flipp’s owned and operated channels.
We are looking for a Data Engineer to join our data enablement engineering team to design, build, and operate data pipelines and libraries that enable access to data and metrics in a data lake and data warehouse to stakeholder groups. In this role, you will work within an engineering team to design and develop data processing platforms and software frameworks for Data Science, Engineering and Analytics organizations.
Most of the things you’ll work on:
- Oversee, design, and develop batch data processing pipelines and libraries
- Develop and manage scalable data processing platforms used by Data Science, Engineering, Analytics & Revenue organizations
- Designing improvements to the Data Lake & Data Warehouse architecture and supporting access libraries
- Consult with Data Science and Analytics to provide best practices for data modeling
- Oversee and develop batch data pipelines that transform, clean, normalize, enrich, and store large data sets
- Oversee and develop libraries that enable performant, clean and easy to use self serve to data in the data lake and data warehouse
- Implement and maintain data pipelines through collection, storage, transformation and normalization of large data sets
- Planning and estimating features the roadmap to determine the next sprint goals
- Fixing bugs and refactoring to improve Flipp internal and open source package
- Design and implement automated unit and integration test strategies
- Analyzing datasets and automating data quality checks to ensure top-notch data quality and consistency
- Develop proper data governance approaches by ensuring security, integrity and auditability standards are met
You’ll need to have:
- Bachelor’s degree Computer Science/Engineering or equivalent
- 4+ years of working in a data engineering department with experience writing ETLs processing large amount of data from raw Data Lakes
- 4+ years of designing for and managing big data platforms based on technologies such as Databricks (preferred), Hadoop, HDFS, and Kafka
- 4+ years of experience working with Apache Spark; with Scala (preferred) or pySpark
- Experience with data formats such as Avro, Parquet, and optimized storage layers such as Delta Lake
- Experience with orchestration tools such as Apache Airflow
- Experience with cloud technologies (AWS preferred)
- Familiarity with data warehousing best practices and star schema design
- Track record of shipping quality code and delivering high quality features
- High growth expectations for yourself and your team, and a willingness to push yourself and your team to achieve them
Here’s how we work:
From working with top technologies to sending you to industry-leading conferences, we will make sure you have all that you need to expand your knowledge and grow your career. We have a trust-based culture where all team members are empowered to work in the way that’s best for them to thrive.
Our culture is at the centre of all that we do. We have been recognized through numerous accolades over the past three years including Best Workplaces in Canada, Deloitte 50 Best Managed, Best Workplaces in Canada for Women, Most Admired CEO and Top 10 Most Admired Corporate Cultures.
Here’s how to apply:
If you’re interested in working with us on the future of shopping, fill out the fields below and submit your application. While experience and skill sets are valuable, growth potential and attitudes are equally important. If you’re prepared to grow dramatically with your team at a world-class learning organization, consider applying. We understand that the most creative solutions require diversity in thought and life experiences.
Flipp is an equal-opportunity employer and values diversity, equity & inclusion. We do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Accommodations are available on request for all aspects of the selection process.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture Avro AWS Big Data Computer Science Databricks Data governance Data pipelines Data quality Data warehouse Data Warehousing Engineering ETL Hadoop HDFS Kafka Open Source Parquet Pipelines PySpark Scala Security Spark
Perks/benefits: Career development Conferences Equity Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open MLOps Engineer jobs
- Open Data Analytics Engineer jobs
- Open Data Scientist II jobs
- Open Power BI Developer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Research Scientist jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open PhD-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Snowflake-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs