Data Engineer

Kuala Lumpur

Applications have closed

Adaptavist

Automate, customise and extend the capabilities of Jira, Confluence, Bitbucket, Slack and Bamboo using ScriptRunner, as well as consulting with Adaptavist services and support.

View company page

About Adaptavist
Adaptavist is a global software innovator, enabling organisations to digitally transform how they collaborate and get work done.  Founded in 2005 and with a growing global reach, our customers cut across every major industry and include more than half of all Fortune 500 companies.
Today, Adaptavist leverages its deep technical understanding of Atlassian and innovative partnership with Slack to help organisations embrace new ways of working to achieve competitive advantage. 
Through trusted consultancy, app development, training, hosting, and licensing solutions, Adaptavist has established itself as the go-to partner of choice within the Atlassian Ecosystem.
About the role
The Data Engineer will build and scale reliable data pipelines and analytics infrastructure. They will work with an industry leader, and an expanding customer base from SMBs to Fortune 500 in scale. This role is pivotal to the growth of the organization, and they will work closely with our Analytics, Data Science, Product and Platform teams. The rest of the team is based in the UK and Canada so they will work on a remote basis.

What you'll be doing

  • Working closely with Analytics and Development teams, the successful candidate will be responsible for growing Adaptavist’s Data ingestion pipelines, and the infrastructure needed to scale our Integrations and Analytics services.
  • Using modern development technologies (Serverless, AWS Glue, Redshift, Athena and Snowflake) and languages (Typescript/Python), our Data Engineering team are focused on building a best-in-class infrastructure to ensure the continued growth of Adaptavist.
  • The Data Warehouse Engineer will own these pipelines from Source to Stream to Storage, ensuring that data flows to the right team, at the right time.
  • Our Data Engineer teams build on modern development practices, so comfort with continuous delivery and deployment, infrastructure as code (Terraform, CDK), and agile experience are a must.
  • The team values the autonomy that modern development teams thrive in, and give teams the space to build and grow in their own ways.

What we're looking for

  • Proven experience in the field of Data Engineering
  • Experience with modern languages like Python 
  • Passion for delivering large-scale Data Pipelines and Warehousing solutions
  • AWS Experience (we use S3, Lambda, Kinesis, and more)
  • Experience with modern development tooling like git
  • Experience with execution frameworks like Apache Airflow
  • Proven experience solving complex problems in a timely manner
  • Experience writing unit and integration tests 
  • Experience with both batch processing and streaming architectures

A few nice to haves

  • Experience coding in Typescript
  • Previous experience running services on Kubernetes
  • Familiarity with the Atlassian suite of tools
  • Developing against RESTful endpoints
  • Experience with Serverless frameworks and methodologies
  • Experience with any of the following: Hadoop, Spark, Tensorflow, Kafka
  • Experience with Amazon Firehose, Kinesis or other Event ingestion frameworks


Please check out our website to review our global benefits!
At Adaptavist, we are committed to promoting a diverse and inclusive community, and believe this positively impacts both the creation of our innovative products and our delivery of bespoke solutions to our global customers and our own unique culture. We encourage all qualified applicants, regardless of age, disability, race, sexual orientation, religion or belief, sex, gender identity, pregnancy and maternity, marriage, and civil partnership status. From our family-friendly policies to our flexible work environment we offer a range of benefits and policies in order to support staff from all different backgrounds. If you have any questions, please do ask us. We look forward to your application!

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: Agile Airflow Architecture Athena AWS Data pipelines Data warehouse Engineering Firehose Git Hadoop Kafka Kinesis Kubernetes Lambda Pipelines Python Redshift Snowflake Spark Streaming TensorFlow Terraform TypeScript

Perks/benefits: Career development Flex hours

Region: Asia/Pacific
Country: Malaysia
Job stats:  15  0  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.