Data Engineer

Data Engineer sought for an initial 6-month contract!

The Opportunity

Datacom have an opening for a senior data engineer to join a significant data consolidation project, developing our Azure Data Lake aggregating all information across Datacom globally.

This is an opportunity to be involved in shaping the data architecture of one of the largest IT providers in Australasia. You’ll be reporting directly to our product owner and will be key in delivering real transformation as our primary data engineer, ensuring our Azure environment meets best practice, and delivers on the requirements of the project.

You will be reviewing any manual work in the team of 6 people, and determining the best pathway for automation.

You will have overall responsibility for;

• ADF
• G2 Datalake
• Any SQL Servers / containers and databases within the environment
• Azure Monitoring
• All blob and file storage within the environment
• Azure KeyVault
• Accounts and permissions within the tenancy
• All data ingests into the environment
• Any data exiting the environment
• Determining the architecture for the Synapse database

About You

Our ideal candidate has a knack for seeing solutions and opportunities in sprawling data sets and the business mindset to convert insights into strategies and action, and the ability to work broadly within an organisation.

Skills you’ll bring

• Strong skills in Azure Data Factory and Data Flows, Azure Databricks, and Azure data platform.
• Advanced database skills
• Advanced data modelling skills (Star schema, Snowflake schema, data vault)
• Proven record of building EDW
• Advanced ETL /ELT processes design and implementation
• Advanced semantic layer (Tabular, Cube) development
• Strong skills in BI visualisation and reporting tools
• Extensive experience with developing, unit testing, break/fix support of ETL
• Advanced skills in performance tuning, query plan, query plan analysis, indexing, table partitioning
• Strong skills in cloud platforms such as Azure, AWS & GCP
• Strong skills in master data management, data quality and data governance
• Strong consultation and client management skills
• Strong understanding of Agile delivery methodology
• Strong documentations skills
• Excellent verbal and written communications
• Machine Learning frameworks and theory
• Analytic platforms & tools such as Databricks, Alteryx, SAS, KNIME or Datarobot
• Custom programming skills (C#, Python etc)
• Data vault Methodology
• DevOps / DataOps

Helpful Knowledge

About Datacom:

At Datacom we believe that doing good, is good for business. We’ve maintained our local family feel whilst expanding globally, across Australia, ASIA, US and the UK. Our brand and reputation depend on ‘looking beyond today’, ‘thriving together’ and ‘exceeding customer expectations’ and we aspire to be the trusted advisor for our customers across Government and the private sector from enterprise scale to regional business. There is space to grow and develop and put your stamp on the organisation and most importantly our customer outcomes.

This is a huge growth area in NZ tech, so whilst this is a contract role – the successful candidate will have the opportunity to pursue full time roles if they are of interested in joining the family!