Big Data Tech Lead (DevOps) (Bangkok based, Relocation provided)
Bangkok
About Agoda
Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with more than 2.5 million accommodations globally. Based in Asia and part of Booking Holdings, our 6,000+ employees representing 90+ nationalities foster a work environment rich in diversity, creativity, and collaboration. We innovate through a culture of experimentation and ownership, enhancing the ability for our customers to experience the world.
The Opportunity:
Our systems scale across multiple data centres, totalling a few million writes per second and managing tens of petabytes of data. We deal with problems from real-time data-ingestion, replication, enrichment, storage and analytics. We are not just using Big Data technologies; we are pushing them to the edge.
Join us in the team that handles our Data Lake, a crucial platform that serves a wide range of business critical needs and applications from being used to train ML models for user-facing applications, to enabling reporting and monitoring, to empowering Product Owners to do research and experimentation hypothesis. The data lake is the very heart of our data-driven culture and spans hundreds of servers across multiple data centres at tens of PB scale.
In this Role, You will get to:
- Improve scalability, stability, accuracy, speed and efficiency of our existing data systems
- Debug , Patch, Contribute, and Administer open source software like Hadoop Ecosystem Projects, Spark, Trino, S3 compatible Object Storage, Docker
- Design, build, test and deploy new libraries, frameworks or full systems for our core systems while keeping to the highest standards of testing and code quality
- Work with experienced engineers and product owners to identify and build tools to automate many large-scale data management / analysis tasks
What You’ll need to Succeed:
- Bachelor's degree in Computer Science /Information Systems/Engineering/related field
- Expert level understanding of Java, Python, or Scala
- 5 years experience administering Big Data technologies/tools/clusters at scale
- Strong experience using Spark
- Expert level understanding of the following technical stack: HDFS, YARN, Oozie, Spark, MPP SQL engines like Impala or Trino
- Good understanding of the following technologies: Object Storage, Kerberos, Kubernetes
- Experience debugging and resolving production issues from large Data Lake Deployments
- Good understanding of the Linux Kernel with advance Linux systems administration skills
It's Great if you have:
- Good understanding of Hadoop ecosystems
- Hadoop Administrator Experience
- Experience working with private or public Cloud Computing and/or Object Storage
- Experience working with Open-source products
- Working in an agile environment using test driven methodologies
#sydney #melbourne #perth #paris #london #tokyo #dhaka #edinburgh #liverpool #manchester #amsterdam #munich #berlin #toronto #vancouver #moscow #dublin #seoul #hcmc #telaviv #taipei #ENG #IT #4 #LI-PK1
Equal Opportunity Employer
At Agoda, we pride ourselves on being a company represented by people of all different backgrounds and orientations. We prioritize attracting diverse talent and cultivating an inclusive environment that encourages collaboration and innovation. Employment at Agoda is based solely on a person’s merit and qualifications. We are committed to providing equal employment opportunity regardless of sex, age, race, color, national origin, religion, marital status, pregnancy, sexual orientation, gender identity, disability, citizenship, veteran or military status, and other legally protected characteristics.
We will keep your application on file so that we can consider you for future vacancies and you can always ask to have your details removed from the file. For more details please read our privacy policy.
To all recruitment agencies: Agoda does not accept third party resumes. Please do not send resumes to our jobs alias, Agoda employees or any other organization location. Agoda is not responsible for any fees related to unsolicited resumes.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Big Data Computer Science Data management DevOps Docker Engineering Hadoop HDFS Java Kubernetes Linux Machine Learning ML models MPP Oozie Open Source Privacy Python Research Scala Spark SQL Testing
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Junior Data Scientist jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Manager jobs
- Open Data Quality Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs