Senior Data Engineer

Asia’s leading technology group, KKCompany Technologies （KKCompany）, is a leader in software services. Our mission is to build “Freeways to Inspiration” and help industries achieve digital transformation. By creating technology highways with partners, we deliver our services around the world and drive value creation through future technology.
In addition to our flagship brands KKBOX, KKStream, and Going Cloud, our core technologies cover various fields such as music streaming, multimedia, and cloud services. Through a range of products and services, we help customers create commercial value. We also offer software services and solutions to over tens of millions of customers with corporate clients across Asia covering various industries such as telecommunications, entertainment and multimedia, media, education, and fitness centers.
We have over 500 employees across offices in Tokyo, Singapore, Taipei, Kaohsiung, and Hong Kong.
What is a Data Engineer?Data engineers are mainly tasked with transforming data into a format that can be easily productized. They do this by developing, maintaining, and testing infrastructures for data generation. Data engineers work closely with data scientists and are largely in charge of architecting solutions for data scientists that enable them to do their jobs.

Responsibilities:

• Take ownership and increase automation of the complex data flow to enable rapid experimentation in a nimble engineering organization.
• Support to implement the business logic to be compatible with real-time/stream processing frameworks.
• Implement anomaly detection techniques for data quality to surface metric shifts on datasets with dozens of dimensions.
• Improve internal process improvements including automating manual processes, optimizing data delivery, and re-designing infrastructure for scalability.

Requirements:

• Distributed data processing at scale (Spark, Hadoop or AWS)
• Large-scale storage and retrieval (Hadoop, ElasticSearch or Druid)

Nice To Have:

• Experience with Infrastructure-as-code (IaC) tools (AWS CloudFormation or Terraform).
• Programming experience manipulating and analyzing data (Scala, Java or Python, Golang)
• Autonomy in managing cross-functional engineering projects