Data Pipeline Engineer (Bangkok based, relocation provided)
Bangkok (Central World Office)
About Agoda
Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with more than 2.5 million accommodations globally. Based in Asia and part of Booking Holdings, our 4,000+ employees representing 90+ nationalities foster a work environment rich in diversity, creativity, and collaboration. We innovate through a culture of experimentation and ownership, enhancing the ability for our customers to experience the world.
Get to Know our Team
The Data department oversees all of Agoda’s data-related requirements. Our ultimate goal is to enable and increase the use of data in the company through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company’s culture of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when you have enough of it, and we have plenty. This is what drives up the challenge as part of the Data department, but also the reward.
The Opportunity
As a data engineer, you will work on distributed systems spanning multiple data centers, thousands of servers, and hundreds of billions of messages a day. Ensuring data quality, data integrity, and data accuracy is a core part of our identity. Design for the new scalable system in which data is increasing day by day, including auditing and monitoring systems. You will be eager to solve problems that come from managing and making sense of large amounts of data. Some of the things you'll get to work on include schema registry, real-time data-ingestion, cross data center replication, enrichment, storage, and analytics of the data flow.
We are a small passionate team, and we are looking for exceptional individuals to be a part of designing, building, deploying (and probably debugging) our Data Pipeline.
In This Role, You’ll Get to
- You will build, administer and scale data pipelines that process hundreds of billions of messages a day spanning over multiple data centers
- You will develop and expand upon existing frameworks that is used by Teams throughout Agoda to produce messages to the data pipeline
- You will build and manage data ingestion into multiple systems (Hadoop, ElasticSearch, other Distributed Systems)
- You will build tools that monitor high data accuracy SLAs for the data pipeline
- You will explore available new technologies that improve upon our quality of data, processes and data flow
- You will develop quality software through design review, code reviews and test driven development
What You’ll Need to Succeed
- Bachelor’s degree in Computer Science / Information Systems / Computer Engineering or related field
- 2 plus years of industry experience, preferred at a tech company
- Good knowledge of data architecture principles
- Have operational experience debugging production issues
- An experienced coder, who can stand your ground with experience building systems with purpose that are flexible, well-tested, maintainable and scale
- You’re detail oriented considering every outcome of a particular decision
- You can communicate in technical English with fluidity, both verbal and written
It’s Great If You Have
- Good understanding of how Kafka works
- Kafka Administrator Experience
- Understands Concepts relating to Schema Registry and Schema Evolution
- Experience working with Serialization Formats either with ProtocolBuffers, Avro or Thrift
- Knows how to use ElasticSearch proficiently
- Experience with data ingestion from Kafka into Hadoop, ElasticSearch, other Distributed Systems
- Strong systems administration skills in Linux
- Worked on or contributed to Open Source Project
#sanjose #losangeles #tirana #sydney #melbourne #perth #vienna #baku #minsk #brussels #saopaolo #sofia #vancouver #shanghai #beijing #shenzhen #zagreb #cyprus #copenhagen #cairo #alexandria #giza #estonia #helsinki #paris #tbilisi #berlin #athens #hongkong #budapest #jakarta #dublin #telaviv #milan #rome #tokyo #osaka #amman #riga #beirut #vilnius #luxembourg #kualalumpur #amsterdam #oslo #jerusalem #manila #warsaw #lisbon #doha #bucharest #moscow #belgrade #bratislava #barcelona #madrid #stockholm #zurich #taipei #tainan #istanbul #london #kiev #hcmc #sanaa #marrakech #wroclaw #Gdansk #lublin #rio #ENG #IT #4 #LI-TS1
Equal Opportunity Employer
At Agoda, we pride ourselves on being a company represented by people of all different backgrounds and orientations. We prioritize attracting diverse talent and cultivating an inclusive environment that encourages collaboration and innovation. Employment at Agoda is based solely on a person’s merit and qualifications. We are committed to providing equal employment opportunity regardless of sex, age, race, color, national origin, religion, marital status, pregnancy, sexual orientation, gender identity, disability, citizenship, veteran or military status, and other legally protected characteristics.
We will keep your application on file so that we can consider you for future vacancies and you can always ask to have your details removed from the file. For more details please read our privacy policy.
To all recruitment agencies: Agoda does not accept third party resumes. Please do not send resumes to our jobs alias, Agoda employees or any other organization location. Agoda is not responsible for any fees related to unsolicited resumes.
Tags: Avro Computer Science Data pipelines Distributed Systems Elasticsearch Engineering Hadoop Kafka Linux Open Source Pipelines
Perks/benefits: Career development Flex hours Flex vacation Startup environment Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open AI Engineer jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs