Senior Data Engineer

About UsInDebted is changing the world of consumer debt collection for good. We’ve disrupted the traditional debt collection industry by providing businesses with a better way to support overdue customers to get back on track. Our solution is product-led, driven by AI and ML, and places customer experience at the core.
We’re fully remote, with a team of over 300 people living and working all around the world. Founded in Australia, we’ve since expanded into the United States, United Kingdom, Canada, and New Zealand. We’ve doubled our revenue year over year, with significant growth on the horizon. Now is an incredible time to join the team as we continue on our mission to help millions of consumers resolve debt, better.
Role OverviewWe are seeking a Senior Data Engineer to join our foundational engineering team. This role is pivotal as we embark on building a new data lake from the ground up using AWS native components alongside Spark, Iceberg, and DBT. Our data journey is just beginning, with our initial few billion events falling within a 1-20 terabyte range. We anticipate the increasing relevance of big data technologies such as Spark, Kafka, and Samza in the near future.

Key Responsibilities:

• Design, build, and maintain scalable data pipelines and infrastructure to support our data lake initiative.
• Utilise AWS native components in conjunction with Spark, Iceberg, and DBT to construct efficient data solutions.
• Collaborate with cross-functional teams to ensure data accuracy, integrity, and availability for various business needs.
• Continuously evaluate and integrate emerging big data technologies (e.g., Spark, Kafka, Samza) to enhance our data architecture.
• Implement infrastructure as code using CDK and Terraform to manage and deploy cloud resources.
• Embrace a language-agnostic approach, selecting the best tools and technologies suited to the problem space.

Requirements:

• Minimum of 5 years of experience as a data engineer.
• Strong expertise in AWS and experience with CDK and Terraform or equivalent IaC frameworks.
• Proficiency in big data technologies, with prior exposure to Spark and Kafka preferred.
• Demonstrated ability to design and implement scalable, secure, and cost-effective data solutions.
• Language-agnostic, with a deep understanding of various data technologies and frameworks.
• Excellent problem-solving skills and the ability to work autonomously.
• Strong values of truth, knowledge, and transparent collaboration across different functions.

Preferred Qualifications:

• Experience with data lake architecture and implementation.
• Familiarity with real-time data processing frameworks such as Kafka and Samza.
• Prior experience in building and scaling data platforms for high-volume transactions.
• Knowledge of data modelling, ETL processes, and data warehousing best practices.

What We Offer:

• Competitive salary and benefits package.
• Opportunity to work in a fast-growing, profitable company with a global reach.
• Collaborative and innovative work environment.
• Autonomy and trust to shape the future of our data infrastructure.
• The chance to make a significant impact on the consumer debt recovery industry.

Interested candidates should submit their resume and a cover letter detailing their relevant experience and why they are interested in joining InDebted. Join us at InDebted and help us scale our platform for the next billion transactions and beyond. We look forward to building a future where financial stability is accessible to all.
Our Benefits 
Recognised by the AFR as Australia's Best Place to Work in 2022, the benefits of life at InDebted include:Flexible working - We’re a global, fully remote team passionate about making work, work for youEmployee equity - Access to share options in something bigFlexible paid leave - Our trust-based leave model enables you to choose when you take leave, how much you take, and what you take it forUprise - Our EAP Provider supports your physical, social & psychological wellbeingRemote work set-up - Budget of AUD $750 (or local equivalent) to help you create a working environment that supports your productivity
At InDebted, we respect and celebrate the unique attributes, characteristics, and perspectives that make each person who they are. We also believe that bringing diverse individuals together allows us to build better products and a better overall company. InDebted is an Equal Opportunity Employer.
For Recruiters: We appreciate the interest of all candidates and recruitment agencies, however for this role we are managing this hiring process internally and will not be accepting applications through recruitment agencies. Thank you