Tech Lead - Big Data

Our vision is to become your Online Shopping Companion, the place where Southeast Asia’s 600M people start their e-commerce journey, where consumers discover the latest deals, compare prices and save money. With more than 6 billion offers on our platform, 100+ million unique shoppers last year, and a reputation as an independent authority when it comes to insights about the regional e-commerce sector, iPrice is at the centre of Southeast Asia’s e-commerce revolution.

Why join us?

Surround yourself with people who are ambitious, passionate, dynamic and constantly looking for ways to improve themselves:

• Work in a Booming Sector with Exciting Challenges;
• Connect with an Inspirational Leadership Team;
• Hyper-charge your Personal Growth;
• And don't miss out on our Awesome Culture

As a Tech Lead – Big Data, you will provide technical leadership, lead software/data engineering initiatives, and build end-to-end high performing data pipeline that is highly available, scalable, stable, and cost-effective to achieve a checkout-quality product catalogue used by hundreds of millions across SEA.

Responsibilities

• Lead the building of iPrice catalogue data pipeline, truly big data with a 7+ billion product catalogue and still growing

• Work closely with product managers and stakeholders to design the technical architecture to meet the requirements of the proposed solution. This includes accountability for performance, availability management, capacity planning, and security
• Collaborate with the team to produce high-quality code that allows us to put solutions into production, confidently ship large features and improvements
• Provide leadership and mentorship in software/data engineering best practices to help engineers grow in their technical responsibilities and remove blockers to their autonomy, including agile development methodologies, service architectures, and design patterns
• Ensure the data completeness, consistency, accuracy, validity, and timeliness
• Identify, design, and implement internal process improvements: implementing underlying infrastructure (in collaboration with DevOps team) for greater scalability, optimizing data delivery, and automating manual processes

Requirements

• 8+ years of industry experience as a backend/full-stack software engineer with min. 2 years experience in architecting and delivering big data solutions on public cloud
• Proven track record in leading teams and building large-scale data pipeline
• Ability to build relationships and drive alignment with excellent verbal and written communication skills
• Ability to perform data analysis and explain complex technical data concepts in the context of solving a business problem
• Experience with the primary tools we use: PHP (Laravel), Angular, Python (PySpark), Airflow, Docker, AWS, Terraform, ElasticSearch, Cassandra, Git
• Experience in Big Data technologies (e.g., Hadoop, Hive, Spark, Kafka) and exposure to resource/cluster management technologies for data workflows including:
  
  • Ingestion
  • Batch and/or stream processing
  • Storage and archiving

Benefits

• Comprehensive healthcare benefits (including outpatient, in-patient, dental & pharmaceutical benefits for you and your family)

• Accelerated career progression support by structured training/development programs (including Internal curriculum, IELTS and external training support)
• Numerous Office perks (including monthly lunch & team allowances, claimable grab rides in past 7:30pm; stocked pantry; subsidised vending machine and plenty of events)
• Support for non-Malaysians (including relocation / work permit and visa support)