Data Engineer
Sydney, Australia
XREF
Xref HR software automates your people journey. Make better hiring decisions. From candidate reference checks to talent pooling and exit surveys. Learn more.Company Description
Xref is a global, best in class, HR and recruitment technology company that empowers organisations with people-focused feedback to make great decisions. Recruit, retain and remember your people with Xref’s automated reference, pulse and exit surveys.
We are a global, ASX-listed company with users in 195 countries. When you work with Xref, you work with a vast array of clients of all sizes and industry backgrounds. Our users love and trust us - we have a 4.7 star rating out of 5 on Google, G2 and Capterra.
Xref's vision is to make it easier for the world to hire and track talent throughout their journey by changing the way organisations collect and action feedback from their people. We're growing rapidly with plenty of exciting new developments and opportunities in play!
Job Description
How will you contribute to the Xref team?
This is a great opportunity for a budding data engineer to gain a strong foundation in a high performing company. You will work with leading technologies and be supported by a highly experienced team to deliver the information, analytics and capability needed for Xref to be a customer focused, data driven organisation.
You will design, build, run and support cloud-based data processing platforms, real time workload and streaming data flows in a large utility environment.
Your key responsibilities will be:
- Software design
- Software deployment on AWS
- Data design
- Develop, test, and maintain data/software applications to extract data from diverse and scattered sources, and transform and load it into several different storage systems.
- Develop, test, and maintain software applications to connect and extract data from diverse external APIs
- Create AI systems to process unstructured data to solve classification and dimensionality reduction problems.
- Implement, manage, and upgrade data infrastructure and software applications for the numerous present and coming data workloads.
- Collecting requirements for the development of new data systems.
- Compose extensive documentation on software applications, data assets, data lineage, and data products.
- Give support on data and data system matters as SME, sharing best practices on software design and data handling.
Qualifications
What do you need?
- You are already a software engineer looking to work in an agile team with cutting-edge technology and you have been a Python developer for a minimum of 3 years with a key interest in data Previous usage in SQL and AWS is essential
- Demonstrated experience of cloud storage systems (AWS), relational databases and distributed computation to create efficient, scalable data systems.
- Demonstrated experience of data integration from multiple heterogeneous sources (apis and data storages).
- Exposure across multiple languages (python essential)
- Awareness of machine learning techniques and supporting system designs.
It would be great if you possess the following, however not essential: Data Modeling, Data Warehousing, Data Streaming (Kafka, firehose, Visualisation Building (Tableau)), MongoDB, Elasticsearch, DynamoDB
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs AWS Classification Data Warehousing DynamoDB Elasticsearch Firehose Kafka Machine Learning MongoDB Python RDBMS SQL Streaming Tableau Unstructured data
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Business Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs