Big Data Lead Engineer/Architect - Geo

Singapore

Full Time
Shopee logo
Shopee
Apply now Apply later

Posted 3 weeks ago

Job Description

  • Lead Shopee Geo big data team to design, develop and maintain Geo data platform which serves all business lines
  • Build and maintain geo data warehouse, managing PB-scale data sets and processing hundreds of billions of incremental data daily
  • Responsible for the full lifecycle of big data products, including data extract, transform, clean, move, model, statistics, aggregation, query and attribution
  • Lead team to design, develop, and maintain internal LBS related data visualization platform
  • Lead team to accomplish good design in dataflow, big data warehouse, schedule system, query engine, data services, system analysis to facilitate usage of geo big data
  • Keep up with best practices in the industry and create an exceptional and competitive geospatial big data platform

 

Requirements

  • Minimum B.S. degree in Computer Science, GIS or a related technical field; Well versed in CS fundamentals, data structures and algorithms; Good knowledge in at least one programming language like C/C++, Golang, Java
  • 5+ years of working experience with minimum 2 years in map or LBS related fields
  • Deep understanding of big data tools such as Hadoop, Spark, Flink, Hive, Hbase, Kafka, Kylin, Druid, etc.
  • Willingness to delve into business scenario, sensitive to business data; Strong communication skills, teamwork skills and ability to drive cross team projects
  • Work experience related to Data visualization / Web development / 0-1 big data project will be plus
  • Leadership experience as Dev Lead or Tech Lead will be a plus
Job tags: Big Data Hadoop Java Kafka Spark
Share this job: