Principal GCP Data Engineer
Sydney, New South Wales, Australia
Simple Machines
Data Engineered to Life. Engineering and software development for data.Join Simple Machines and be part of our mission to help clients unlock the full potential of their data through the creation of cutting-edge business driven data platforms and software solutions. As we continue to expand our team across Australia and New Zealand, we are seeking Principal Data Engineers who are unafraid to challenge the status quo and push boundaries.
The Exciting Part
Simple Machines is not your average consultancy or software engineering firm. Our team is comprised of inspiring technical leaders in Data Engineering, Machine Learning, and Artificial Intelligence. Our projects are data-focused and drive impactful business outcomes.
Requirements
Requirements
- Understanding of big data considerations, such as security, governance, reliability, and scalability
- Hands-on experience with batch processing and streaming tools and technologies, such as Spark, Kafka, Flink, DBT, and Athena
- 3+ years experience with Google Cloud Platform (GCP)
- Proficiency in programming languages such as Python, Java, Scala, GoLang, or Rust
- Experience with data warehousing technologies (BigQuery, Snowflake, Databricks) and data storage formats (Parquet, Delta, ORC, Avro, JSON)
Nice-to-Haves
- Current certifications in GCP (for example Professional Data Engineer)
- Experience with infrastructure as code tools (Terraform, Pulumi, CDK)
- Knowledge of containerised solutions (Docker, Kubernetes)
- Familiarity with CI/CD tools (GitHub Actions, Azure DevOps, JetBrains TeamCity, Octopus Deploy, ArgoCD)
- Experience with testing tools and frameworks (DBT, Great Expectations, Soda)
Unless otherwise stated: You must have full working rights in Australia
Benefits
Working at Simple Machines
We’re looking for someone who’s as passionate as we are about building a world-class technology company specialising in engineering for data.
Just some of the benefits of working with Simple Machines include:
- Flexible working: Want to work from home or leave early to pick up the kids? Need to start early some days, later on others? No problem!
- Generous parental leave: Three months’ fully paid primary carer leave and one month fully paid secondary carer leave, subject to a minimum 12 month tenure
- Learning and development: We all love continually learning and have a generous budget for you to upskill, join conferences, get certified and qualified
- Lunch is on us. Always! We happily supply lunch at each of our office locations every Monday, Wednesday and Friday.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Athena Avro Azure Big Data BigQuery CI/CD Databricks Data Warehousing dbt DevOps Docker Engineering Flink GCP GitHub Golang Google Cloud Java JSON Kafka Kubernetes Machine Learning Parquet Python Rust Scala Security Snowflake Spark Streaming Terraform Testing
Perks/benefits: Career development Conferences Flex hours Parental leave
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Data Scientist II jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Junior Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open DevOps-related jobs