Data Engineer
Brisbane, Queensland, Australia
Go1
Go1 offers the largest curated eLearning library from top training providers in a single subscription. Integrated with leading LMS, HRIS systems.Here at Go1, we are committed to providing the best learning opportunities to improve lives through education and training.
The Go1 Content Hub is the largest curated eLearning library from the world’s top training providers, available for a single subscription within an existing learning platform, or available on ours.
We are proud of our team culture where everyone can contribute, have a positive impact and be part of the Go1 journey.
We celebrate each other’s wins and support one another so we can grow as individuals, as teams and as an organisation.
The role:
We are currently looking for an experienced contract Senior Data Engineer. The Senior Data Engineer will be responsible for technical delivery within the go1Dataplatform technical domain. Working closely with business & product teams and our technical architects, you will be setting data platform development best practice aligned to the architecture design. You will be instrumental in delivering our data driven organisation future.
Key Responsibilities:
- Build Data pipelines to Acquire, Store, Transform & Surface enterprise data.
- Develop Batch & Streaming use case pipelines: following go1 frameworks & patterns.
- Using Azure Synapse, ADF, PySpark Notebooks, Azure Functions, Azure Streaming Analytics.
- Develop transformation pipelines suppling analytics data to End user systems and stakeholders.
- Develop PowerBI Apps/Dashboards/Reports.
Requirements
About you:
You will be a champion for good development practice and will demonstrate this through practical work, constructive feedback and close collaboration. You will be a critical thinker who is able to rapidly problem solve. You bring you practical experience to this domain, land running from day one. You have a talent for getting the balance and fidelity of documentation and practical knowledge transfer, just right.
You will have:
- Azure Datalake 2
- Parquet, Avro, Delta file formats
- Acquiring data from Azure Event Hubs (Kafka)/Rest API/Database's
- Azure Data Factory / Synapse Orchestrate (Dataflows)
- Databricks/Synapse Notebooks
- PowerBI, DAX, setting up shared data sets & dataflows
- Exceptional T-SQL, PySpark (Python)
- Nice to have: .net Development (Azure Functions)
Benefits
What makes Go1 special? Every one of our employees. When we work together, extraordinary things happen! When you join the Go1 team, you not only get to work with an outstanding bunch of people, but you're also supported to continue your own personal growth and development in an inclusive and flexible environment, with benefits including:
- Company bonus scheme
- Flexible work options - we value work life balance
- Unlimited access to the Go1 Learning Hub
- Financial support for professional development
- 10 weeks full pay Primary Carer Parental Leave
- Yoga and Running Clubs
- Wellness programs
- Employee Assistance Program
- Free on-site weekly lunch
- Free on-site drinks and snacks
- Bring your pet to work...and more
Tags: APIs Avro Azure Databricks Data pipelines Kafka Parquet Pipelines Power BI PySpark Python REST API SQL Streaming T-SQL
Perks/benefits: Career development Flex hours Parental leave Salary bonus Wellness Yoga
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs