Data Engineer
Sydney, New South Wales, Australia
Location: Sydney,New South Wales,Australia
Quantium
Since 2002, Quantium have combined the best of human and artificial intelligence to power possibilities for individuals, organisations and society. Our solutions make sense of what has happened and what will, could or should be done to re-shape industries and societies around the needs of the people they serve.
As one of the world’s fully diversified data science and AI leaders we operate across every sector of the economy and we’re growing fast - with growth comes opportunity! We’re passionate about building out our team of smart, fun, diverse and motivated people.
We combine a team of experts that spans data scientists, actuaries, statisticians, business analysts, strategy consultants, engineers, technologists, programmers, product developers, and futurists – all dedicated to harnessing the power of data to drive transformational outcomes for our clients.
The Role
As a Senior Engineer you will be responsible for developing readable, maintainable and efficient code to realize user stories that deliver the product road-map.
You will be accountable for coordinating Engineers and other stakeholders in breaking down large epics into collections of smaller stories / tasks and in implementing the overall functionality.
Through active participation in Scrum ceremonies, you will contribute to the product road-map and collaborate with other Engineers and Analysts to assist in defining the technical direction for the product. You will also work with support teams to ensure the product's smooth operation.
Key responsibilities
- Produce Quality Code
- Code follows team standards, is structured to ensure readability and maintainability and goes through review smoothly, even for complex changes
- Designs respect best practices and are favourably reviewed by peers
- Critical paths through code are covered by appropriate tests
- High-level designs / architectures align to wider technical strategy, presenting reusable APIs where possible and minimizing system dependencies
- Data updates are monitored and complete within SLA
- Operate at a High Level of Productivity
- Estimates are consistently ‘challenging, but realistic
- Most tasks are delivered within estimate
- Complex or larger tasks are delivered autonomously
- Squad Collaboration
- Sprint goals are consistently achieved
- Demonstrate commitment to continuous improvement of squad activities
- The product backlog is consistently well-groomed, with a responsible balance of new features and technical debt mitigation
- Other Engineers in the Squad feel supported in their development
Key activities
- Write polished code, aligned to team standards, including appropriate unit / integration tests
- Review code and test cases produced by others, to ensure changes satisfy the associated business requirement, follow best practices, and integrate with the existing code-base
- Provide constructive feedback to other team members on quality of code and test cases
- Collaborate with other Lead / Senior Engineers to produce high-level designs for larger pieces of work
- Validate technical designs and estimates produced by other team members
- Merge reviewed code into release branches, resolving any conflicts that arise, and periodically deploy updates to production and non-production environments
- Troubleshoot production problems and raise / prioritize bug tickets to resolve any issues
- Proactively monitor system health and act to report / resolve any issues
- Provide out of hours support for periodic ETL processes, ensuring SLAs are met
- Work with business stakeholders and other leads to define and estimate new epics
- Contribute to backlog refinement sessions, helping to break down each epic into a collection of smaller user stories that will deliver the overall feature
- Work closely with Product Owners to ensure the product backlog is prioritized to maximize business value and manage technical debt
- Contribute to work breakdown sessions to define the technical tasks required to implement each user story
- Contribute to sprint planning sessions, ensuring the team takes a 'realistic but challenging' amount of work into each sprint and each team member will be productively occupied
- Contribute to the team’s daily stand-up, highlighting any delays or impediments to progress and proposing mitigation for those issues
- Contribute to sprint review and sprint retro sessions, to maintain a culture of continuous improvement within the team
- Coach / mentor more junior Engineers to support their continuing development
- Conduct technical interviews as necessary to recruit new Engineers
Experience and education required
- 5+ years' experience developing at scale applications using Scala
- Proven experience manipulating large data-sets using Spark
- Solid foundation in functional programming and data structures
- Values delivering high-quality, peer-reviewed, well-tested code
- Awareness of DevOps functions and appetite to contribute to CI / CD pipelines
- Experience working with source control tools (GIT preferred) with good understanding of branching / merging strategies
- Bachelor’s degree in Computer Science, Information Technology or a related discipline
- Comfortable working in a fast moving, agile development environment
- Excellent problem solving / analytical skills
- Good written / verbal communication skills
- Commercially aware, with the ability to work with a diverse range of stakeholders
- Enthusiasm for coaching and mentoring more junior engineers
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Computer Science DevOps ETL Git Pipelines Scala Scrum Spark
Perks/benefits: Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open ETL Developer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs