Senior Principal Architect - Big Data Platform

Markham, ON, Canada

Applications have closed

Huawei Technologies Canada Co., Ltd.

Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices.

View company page

Company Description

About Huawei

With 194,000 employees and operating in more than 170 countries and regions, Huawei is a leading global creator and provider of information and communications technology (ICT) infrastructure and smart devices. Integrated solutions span across four key domains – telecom networks, IT, smart devices, and cloud services. Huawei is committed to bringing digital to every person, home and organization for a fully connected, intelligent world.

About Huawei Canada

Huawei Canada focuses on fundamental research and development aimed at solving complex technical problems in emerging technologies like 5G, AI, Human Computer Interaction and Autonomous Driving. With ongoing research initiatives with 10 Universities across Canada and strategic collaboration agreements with several Universities, we support Canada’s rich research community.  In 2020, Huawei Canada ranked among the Top 20 corporate R&D investors in the country with a huge 40% increase in R&D investment year over year. Huawei Canada was established in 2008 and now has a total workforce of 1,200 in our six research centers across Canada.

Why work with Huawei Canada?

You will have the opportunity to work on real-world problems that impact people across the globe.  Many of our researchers are actively involved in publishing conference and journal papers, inventing patents and solving challenging technical problems. With cutting edge tools, access to highly specialized leaders and researchers, and significant funding, you will be well supported to fulfil your potential and pursue your professional dreams.

Job Description

We are looking for talented, enthusiastic individuals to join Big Data Team within the Distributed Scheduling and Data Engine Lab, based in Markham, Ontario. Our research work focuses on performance optimization in big data analytic scenarios, include low latency, real time and batch scenarios; cover the business analysis job from milliseconds, minutes, to hours execution time. We are seeking technical breakthroughs and innovations from the full-stack standpoint, including: (1) Software-hardware co-design and implement, to enable computing offloading and acceleration. (2) Optimize data reading and writing efficiency and performance from the data storage layer. (3) On the runtime layer, optimize the operator performance, memory format, index, and cache, etc. (4) Optimize API compatibility and usability at the interface layer.

Our vision is to simplify big data. We have teams across Canada, China and India. Our innovative technologies are widely used by Huawei's internal customers, significantly improved their efficiency and performance of big data solutions. In addition, we have led the openLooKeng.io open source project. OpenLooKeng is a drop in bigdata analytic engine which enables in-situ analytics on any data, anywhere, including geographically remote data sources. OpenLooKeng has been open since 2020 and has been integrated and used by 15 well-known enterprises in China's financial and Internet fields, with more than 100,000 downloads.

We expect you to:

  • Be able to chair the architecture design of one or more core systems, and lead the technical team to complete end-to-end delivery.
  • Be able to understand customer requirements and translate them into technical solutions.
  • Be able to gain insights from the industry and academic trends of big data analytics; and provide valuable insight reports that guide technical planning of our global team
  • Mentor and lead fellow developers.
  • Participate in different open source meeting or internal workshop to present team’s solution and build technical influence.
  • Generate intellectual property such as patents and trade-secrets from research findings.

Qualifications

Minimum Qualifications

  • BS, MSc, or PhD in computer science, software engineering, or computer engineering.
  • Familiar with mainstream big data related technologies and distributed frameworks.
  • 5+ years of professional software development experience, strong programming skill in Java or C/C++, including object-oriented design
  • 2+ years of experience contributing to the architecture and design of a system.
  • Hands-on experience on the kernel feature development or optimizing performance for bigdata engine/database, such as: Presto / Trino, Spark, Flink, Hive, HBase, Clickhouse, Postgresql, Mysql etc.

Preferred Qualifications

  • Experience as a PMC member or committer in an open source bigdata project.
  • 2+ years of experience as a mentor, team lead.
  • Proven experience with platform/system level development with performance profiling and tuning skills.
  • Strong collaboration skills
  • Mandarin speaking is a plus

Tags: APIs Architecture Autonomous Driving Big Data C++ Computer Science Data Analytics Engineering Flink HBase MySQL Open Source PhD PostgreSQL R R&D Research Spark

Region: North America
Country: Canada
Job stats:  2  0  0

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.