Sr. Data Engineer / Architect

Position Overview:We are looking for an experienced and versatile Senior Data Engineer to join our dynamic and fast-growing team. If you are passionate about data and solving complex problems, this role could be the perfect fit for you!
ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.
Job Description:Design, develop, and maintain streaming data pipelines using tools such as Apache Spark Streaming, Apache Kafka, and Elasticsearch.Work with both relational (RDMS) and non-relational (NoSQL) data platforms optimizing data processing and analysis.Implement and optimize SQL scripts, ensuring tuning, indexing, distribution, and partitioning strategies for optimal performance in real-time scenarios.Collaborate with multiple teams to understand requirements and coordinate cross-functional solutions.Senior expertise in Python, Java, or R to implement real-time data processing workflows.Explore emerging technologies and tools in the streaming data ecosystem to enhance our data processing capabilities.Provide mentorship and guidance to junior team members on best practices for streaming data engineering.
Basic Qualifications:Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, or a related field.6+ years of solid experience designing and implementing both relational (RDMS) and non-relational (NoSQL) data technology.Minimum 3 years of hands-on experience with streaming technologies such as Apache Spark Streaming, Apache Kafka, and Elasticsearch.Expert-level SQL, Python, and PySpark.Hands-on experience with cloud platforms such as AWS, Azure, or GCP and their ETL/Data tools.Extensive expertise in implementing real-time data processing workflows.
Preferred Qualifications:Masters in Science, Technology, Engineering, or Mathematics Related Discipline.Experience within the AdTech industry is a plus.Experience with Databricks / Apache Delta Lake and Apache Druid.Proficient in utilizing Apache Spark for large-scale data processing and analytics.
We are proud to offer a competitive salary alongside a strong healthcare insurance and benefits package. The role is preferably hybrid, with 2 days per week spent in our downtown Toronto office. We pride ourselves on the growth of our employees, offering extensive learning and development resources. 
ShyftLabs is an equal opportunity employer committed to creating a safe, diverse, and inclusive environment. We encourage qualified applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, nationality, and education levels to apply. If you are contacted for an interview and require accommodation during the interviewing process, please let us know.