Lead Data Engineer - Batching/Streaming
GojekGojek is a Super App. It’s one app for ordering food, commuting, digital payments, shopping, hyper-local delivery, and over a dozen services. It is Indonesia’s first and fastest growing decacorn building an on-demand empire.
As GoPay is undergoing exponential growth, our data has followed the same growth curve. Thus, as an integral member of the Data Engineering team, you'll be at the epicenter of one of Southeast Asia's most coveted companies, and get to witness and solve the challenges that come with rapid scaling.
As our Data Engineer, you'll work closely with the business team and other data teams to improve the accessibility & reliability of data while leveraging the largest-scale data processing technologies in the world. With your strong product-oriented vision and "Do It Yourself" mindset, you'll build data products that will deliver, model, and curate data for the entire Gojek Payments platform.
What You Will Do
- Build a highly scalable and fault tolerant data streaming platform to process and analyze a large volume of messages in real time
- Oversee containerization and deployment of microservices on Kubernetes
- Design and deploy the data engineering applications on Google Cloud Platform
- Manage the auto-scaling and monitoring performances of the Infrastructure using InfluxDB and Grafana, or similar tools
- Collaborate with the team to ensure that the service level objectives and agreements are achieved
- Set up Infrastructure as a code using Terraform and Chef
What You Will Need
- At least 6 years of data engineering, with experience in leading a team and building data engineering applications on a large-scale distributed computing infrastructure in a cloud environment
- In-depth experience in containerization, including Docker and Kubernetes
- Working with large scale production Kafka clusters
- Experience building real-time streaming applications using Kafka and Flink
- Experience working with Agile methodologies, Test Driven Development and implementing CI/CD pipelines using Gitlab and Docker
- Good knowledge of automating and provisioning infrastructure deployments using Terraform and Chef/Ansible on a cloud platform like GCP
- Experience managing distributed systems like Elasticsearch/MongoDB and a server- less data warehouse like BigQuery or Redshift
As GoPay scales rapidly, the need for creating a reliable and scalable data infrastructure becomes increasingly more important. Our Data team is a newly established family, with members stationed across Singapore and India. We’re responsible for running hundreds of instances and deployments across all of our payment products, directly impacting millions of users every single day. Most recently, we've worked on building products that reduce the overall time to model, curate, and access data, streamlining our efficiency and internal processes significantly.
Combating remote work has brought us even closer, with frequent catch-ups over tea and sharing ways we have been keeping ourselves sane. Along with our desire to utilize smart technology and innovative engineering strategies to make people’s lives easier, our team also bonds over our shared love for reading, gaming, and drinking lots of coffee. We work hard and play hard, and believe it or not, we actually enjoy each other’s company!
Gojek is a Super App. It’s one app for ordering food, commuting, digital payments, shopping, hyper-local delivery, and dozen other products. It is Indonesia’s first and only decacorn. It's also the only Southeast Asian startup to be part of Fortune's list of 'Companies That Changed The World.'
Our Mission: To create and scale positive socio-economic impact for our customers, driver-partners, business and MSMEs.
As of 2021, Gojek processed more than $9 billion annualised gross transaction value across all markets where it operates - in Singapore, Thailand, Vietnam and Indonesia. We have the largest food delivery product in Asia, (outside of China), and the largest payments wallet in Southeast Asia.
Our investors include Google, Facebook, PayPal, Sequoia Capital, Tencent Holdings among others.
Gojek is committed to building a diverse and inclusive workplace and is an equal opportunity employer. We do not discriminate on the basis of race, religion, national origin, gender, gender identity, sexual orientation, disability, age, education status, or any other legally protected status.
* Salary range is an estimate based on our salary survey at salaries.ai-jobs.net
Perks/benefits: Startup environment
Other jobs like this
Technical Lead/Architect - Data Engineer (AWS Redshift/Glue+Pyspark)Agile APIs AWS Consulting Engineering ETL Informatica +12
Career development Startup environment
Career development Health care Pet friendly Startup environment Team events
Explore more AI/ML/Data Science career opportunities
Find open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general, filtered by job title or popular skill, toolset and products used.
- Open Data Engineer (Remote) jobs
- Open Data Engineer II jobs
- Open Data Analytics Manager jobs
- Open Junior Data Analyst jobs
- Open Machine Learning Scientist jobs
- Open Computer Vision Engineer jobs
- Open Data Analytics Engineer jobs
- Open Senior Data Analyst (Bangkok Based, relocation provided) jobs
- Open Research Scientist, Computer Vision jobs
- Open Marketing Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Engineering Lead jobs
- Open Autonomous Vehicle System Test Specialist jobs
- Open Head of Data Science jobs
- Open Junior Data Engineer jobs
- Open Data Scientist II jobs
- Open Data Scientist (Remote) jobs
- Open Research Scientist, NLP jobs
- Open Lead Data Analyst jobs
- Open Data Analyst (Remote) jobs
- Open Senior Marketing Data Analyst jobs
- Open Associate Data Analyst- Customer Experience Group | Bangkok-based jobs
- Open Senior Data Engineer (Remote) jobs
- Open Sr. Data Analyst jobs
- Open Director of Data Engineering jobs
- Open Data visualization-related jobs
- Open TensorFlow-related jobs
- Open Looker-related jobs
- Open Excel-related jobs
- Open Snowflake-related jobs
- Open Business Intelligence-related jobs
- Open Redshift-related jobs
- Open Streaming-related jobs
- Open APIs-related jobs
- Open Hadoop-related jobs
- Open Economics-related jobs
- Open Azure-related jobs
- Open PyTorch-related jobs
- Open GCP-related jobs
- Open Kafka-related jobs
- Open Docker-related jobs
- Open Kubernetes-related jobs
- Open Git-related jobs
- Open NLP-related jobs
- Open BigQuery-related jobs
- Open Consulting-related jobs
- Open Pandas-related jobs
- Open Power BI-related jobs
- Open Data Warehousing-related jobs
- Open Scikit-Learn-related jobs