Data Engineer

Company Description

Carousell Group is the leading multi-category platform for secondhand in Southeast Asia on a mission to inspire the world to start selling, and to make secondhand the first choice. Carousell Group Data Engineering is looking for Data Engineering to join us to build self-service data infrastructure platform. Our engineering team is building a robust platform that enables self-serve ingest data, access data and transform data into insights they need, using familiar and comfortable tools. You will have very competitive remuneration with exposure to regional travel within Singapore, Malaysia, Myanmar, Hong Kong, Taiwan for collaboration workshops as well as specific sharing conferences.

Job Description

• Conduct best practices and introduces data tools and methodologies which help to reduce cognitive load for business teams when adopting new technology.

• Creates reusable and self-service data infrastructure and solutions for data ingestion, storage, processing, and consumption through templates, deployable architecture blueprints, developer guides, and other documentation. Also creates Terraform templates, data pipeline templates, container templates, and orchestration tooling.

• Develops and maintains central data services and frameworks to standardize processes for cross-functional concerns such as data sharing, pipelines orchestration, logging and monitoring, data governance, continuous integration and continuous deployment (CI/CD) with embedded security and compliance reporting, and FinOps reporting.

• Build system to process highly complex ETL, high-throughput data for real-time and offline analytic processing.

Qualifications

Must to have:

• 3+ years of related experience in Data engineering roles with BSc, MSc degree in Computer Science related fields

• Familiar with SQL/BigQuery, Kafka, Google Dataflow/Apache Beam;

• Experienced with Python, Golang, Flask framework

• Able to learn, adapt new technology

• Self-motivated, detailed oriented and responsible.

• Very well command of English in both reading and writing.

Nice to have:

• Strong scripting ability in Bash is a plus

• Familiar designing and operating of a robust distributed system is a plus

• Experience in MLOps is a plus

Additional Information

By proceeding with your application, you are adhering to our PDPA policies. In case you are interested to know more, read about our Candidates Personal Data Privacy Statement.