Senior Principal Architect - Big Data Platform
Markham, ON, Canada
Huawei Technologies Canada Co., Ltd.
Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices.Company Description
About Huawei
With 194,000 employees and operating in more than 170 countries and regions, Huawei is a leading global creator and provider of information and communications technology (ICT) infrastructure and smart devices. Integrated solutions span across four key domains – telecom networks, IT, smart devices, and cloud services. Huawei is committed to bringing digital to every person, home and organization for a fully connected, intelligent world.
About Huawei Canada
Huawei Canada focuses on fundamental research and development aimed at solving complex technical problems in emerging technologies like 5G, AI, Human Computer Interaction and Autonomous Driving. With ongoing research initiatives with 10 Universities across Canada and strategic collaboration agreements with several Universities, we support Canada’s rich research community. In 2020, Huawei Canada ranked among the Top 20 corporate R&D investors in the country with a huge 40% increase in R&D investment year over year. Huawei Canada was established in 2008 and now has a total workforce of 1,200 in our six research centers across Canada.
Why work with Huawei Canada?
You will have the opportunity to work on real-world problems that impact people across the globe. Many of our researchers are actively involved in publishing conference and journal papers, inventing patents and solving challenging technical problems. With cutting edge tools, access to highly specialized leaders and researchers, and significant funding, you will be well supported to fulfil your potential and pursue your professional dreams.
Job Description
We are looking for talented, enthusiastic individuals to join Big Data Team within the Distributed Scheduling and Data Engine Lab, based in Markham, Ontario. Our research work focuses on performance optimization in big data analytic scenarios, include low latency, real time and batch scenarios; cover the business analysis job from milliseconds, minutes, to hours execution time. We are seeking technical breakthroughs and innovations from the full-stack standpoint, including: (1) Software-hardware co-design and implement, to enable computing offloading and acceleration. (2) Optimize data reading and writing efficiency and performance from the data storage layer. (3) On the runtime layer, optimize the operator performance, memory format, index, and cache, etc. (4) Optimize API compatibility and usability at the interface layer.
Our vision is to simplify big data. We have teams across Canada, China and India. Our innovative technologies are widely used by Huawei's internal customers, significantly improved their efficiency and performance of big data solutions. In addition, we have led the openLooKeng.io open source project. OpenLooKeng is a drop in bigdata analytic engine which enables in-situ analytics on any data, anywhere, including geographically remote data sources. OpenLooKeng has been open since 2020 and has been integrated and used by 15 well-known enterprises in China's financial and Internet fields, with more than 100,000 downloads.
We expect you to:
- Be able to chair the architecture design of one or more core systems, and lead the technical team to complete end-to-end delivery.
- Be able to understand customer requirements and translate them into technical solutions.
- Be able to gain insights from the industry and academic trends of big data analytics; and provide valuable insight reports that guide technical planning of our global team
- Mentor and lead fellow developers.
- Participate in different open source meeting or internal workshop to present team’s solution and build technical influence.
- Generate intellectual property such as patents and trade-secrets from research findings.
Qualifications
Minimum Qualifications
- BS, MSc, or PhD in computer science, software engineering, or computer engineering.
- Familiar with mainstream big data related technologies and distributed frameworks.
- 5+ years of professional software development experience, strong programming skill in Java or C/C++, including object-oriented design
- 2+ years of experience contributing to the architecture and design of a system.
- Hands-on experience on the kernel feature development or optimizing performance for bigdata engine/database, such as: Presto / Trino, Spark, Flink, Hive, HBase, Clickhouse, Postgresql, Mysql etc.
Preferred Qualifications
- Experience as a PMC member or committer in an open source bigdata project.
- 2+ years of experience as a mentor, team lead.
- Proven experience with platform/system level development with performance profiling and tuning skills.
- Strong collaboration skills
- Mandarin speaking is a plus
Tags: APIs Architecture Autonomous Driving Big Data C++ Computer Science Data Analytics Engineering Flink HBase MySQL Open Source PhD PostgreSQL R R&D Research Spark
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs