Data Engineer

We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods. If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you.

Requirements

• Implement/support new data solutions in datalake/datawarehouse built on snowflake.
• Develop and design data pipelines using python, spark and snowflake.
• Implement infrastructure as code using cloudformation and terraform.
• Design and Implement Continuous Integration/Continuous Deployments pipelines.
• Perform Data Modelling using downstream requirements.
• Develop transformation scripts using advanced SQL and DBT.
• Create reports/dashboard using business intelligence tools such as looker and tableau.
• Write test cases/scenarios to ensure incident free production release.
• Collaborate closely with data analysts and different domains such as Finance, risk, compliance, product and engineering to fulfil requirements.
• Identify areas of improvements in data pipelines, snowflake, infrastructure etc Conduct peer reviews of the code.
• Debug production and development issues and provide support to colleagues where necessary.
• Perform data quality checks to ensure quality of the data exposed to the end users.
• Perform production deployments and perform a post-production support and validation (We follow a “You build, you run it” philosophy)
• Build strong relationships with team, peers and stakeholders.
• Contributes to overall data platform implementation.

• Proficient in SQL/Python/Spark
• Exposure to DBT would be preferable
• Experience in AWS services such as Glue, Lambda, S3, DynamoDB, RDS, Kinesis, ECS/Fargate.
• Experience working with modern data platforms such as redshift or snowflake
• Experience working with BI tools such as looker and tableau
• Experience working with docker
• Proficient in data modelling.

Benefits

We offer

• Flexible working hours (self-managed)
• Competitive salary
• Annual bonus, subject to company performance
• Access to Udemy online training and opportunities to learn and grow within the role

At Mindera we use technology to build products we are proud of, with people we love. Software Engineering Applications, including Web and Mobile, are at the core of what we do at Mindera. We partner with our clients, to understand their product and deliver high performance, resilient and scalable software systems that create an impact on their users and businesses across the world.

You get to work with a bunch of great people, where the whole team owns the project together. Our culture reflects our lean and self-organisation attitude. We encourage our colleagues to take risks, make decisions, work in a collaborative way and talk to everyone to enhance communication. We are proud of our work and we love to learn all and everything while navigating through an Agile, Lean and collaborative environment.

Check out our Blog: http://mindera.com/ and our Handbook: http://bit.ly/MinderaHandbook

Our offices are located: Porto, Portugal | Aveiro, Portugal | Coimbra, Portugal | Leicester, UK | San Diego, USA | Chennai, India | Bengaluru, India

Mindera is an equal opportunity employer and does not discriminate on the basis of age, disability, gender including gender reassignment, marriage and civil partnership, pregnancy and maternity, race, religion or belief, sex, sexual orientation, or any other protected status. All matters related to employment are decided on the basis of qualifications, merit and business need.