Senior Python Data Engineer

Senior Python Data Engineer
Full Time (Part Time 4/5 days accepted) | Portugal

We’re seeking talented, passionate and pragmatic profiles that are obsessed with working with data and getting value out of it.

About Daltix

Daltix provides highly accurate and accessible data to companies active in the dynamic retail industry. We are obsessed about the quality of our data and we thrive on making it work for our customers so that they can make fact-based business decisions. We are proud to have a solid customer base of some of the largest European retailers such as Colruyt Group, Intergamma and Unilever. In the next couple of years, Daltix is focused on further fast growth which means our talent will have a significant impact on creation, development and execution of our product and brand. Daltix was founded in 2016 and has teams located in Belgium and Portugal.

About the job

We scrape around 3TB of compressed data per month (20TB uncompressed), if you'd like to learn how this is done and the challenges that comes with that, here's your chance! To this end, we’re looking for a Senior Python Data Engineer.

You will join our data team who are in charge of standardizing and extracting information from the data we collect, as well as making it accessible for analytics & reporting. Your responsibilities will be a mix of software (Python) & data engineering.

Your responsibilities in this role

1. You and the team will be working together with our data product owner to realise various features from start to finish, ranging from:

   1. Developing new ways to standardise our data further.

   2. Integrating datasets from various sources (scraping, manual field teams, bought datasets) & combining them into an easy to use dataset for our customers.

2. As a senior engineer you’re expected to break up complex projects into small / manageable steps and communicate about them as well as defining ways to reduce uncertainty on projects.

3. You’ll be responsible for the data infrastructure (schedulers, computing frameworks) which is running on our K8s platform (in AWS).

4. Quality Assurance of our data. We are obsessed with data quality and we’re always looking for ways to improve our quality.

Requirements

What we are looking for

• At least 5 years of relevant working experience in Data & Software Engineering; we also value knowledge of Data Analysis, however most of the tasks at first will be Software Engineering in a data context.

• Must-have tech experience (we use everyday):

  • Python, as 99% of our stack is in Python

  • SQL

  • Git

  • Bash

  • VIM (nah just kidding, it's the best one though)

• Nice-to-have tech experience (we use everyday so it's helpful if you know them too):

  • Pandas + Jupyter notebook

  • Regex

  • CI / CD

  • Docker

  • Cloud experience (AWS preferred)

  • K8S, Terraform

• The application process involves a technical challenge. Interviews and the challenge will be conducted remotely.

• We communicate exclusively in English, so fluent technical English is mandatory. Portuguese is not required. Most of our data is in Dutch, so knowledge of Dutch is a plus.

What you can expect from Daltix

• Daltix believes it is powered by its people: You will be joining a team geared up for growth, giving you the unique opportunity to help shape our future as a company. Your day at work will matter. You will join a very special team; nimble, talented, international and highly motivated.

• We believe in flexibility at work. You will have a lot of autonomy in deciding what tasks are important and where you choose to work to keep you inspired. We trust you know your schedule. 

  • For this position we also accept people who prefer to work 4 days per week (salary pro-rata).

  • You may live anywhere in Portugal, we are a remote first company.

• Transparency is our superpower. It means our organization is flat and our culture is open and inclusive.

• We inject fun into work. Virtual or in-person random catch-ups and spontaneous after-work fun is as common as informative monthly company-wide meetings and organized team events.

• Developing yourself is an important cornerstone of our company. Together, we will find relevant training to help you stay ahead of your, and our, game.

• A competitive wage with benefits such as health insurance, group insurance and meal allowance.

We are excited to get to know you better