Senior Python Data Engineer

We are looking for a highly motivated and driven Data Engineer with more than 7 years of experience to help us design and develop solutions for data-intensive projects. We expect this individual to have substantial knowledge of Machine Learning pipelines. You should have at least 4 years of experience deploying Python to production systems, and broad knowledge of how to deploy and set up services for stability and scalability in production environments.

Responsibilities

• Design, develop and implement proof of concept and production-ready middleware and back-end services;

• Create extensible, modular middleware/back-end services to be used by other layers.

• Architect and improve systems to scale our data flows;

• Design, implement, test, deploy, and maintain stable and scalable data engineering solutions and pipelines in support of the machine learning algorithms.

Requirements

Skills

• Python

• Celery

• Flask

• RabbitMQ

• Cassandra

• Kubernetes

• Docker

• AWS

• Microservices architectures

• Redis

• Parquet

• Asynchronous Web Frameworks

Preferred Experience:

• Degree in Computer Science, Information Systems, Software Engineering or related, or 7 years equivalent work experience.

• Continuous Integration/Continuous Deployment is a plus.

• Stability and Capacity patterns are a big plus.

• Have worked with international and remote teams.

DevGrid is a UK-based IT solution provider with an offshore development base in Brazil. 

We believe that world-class software can only be built by a happy and enthusiastic team, and in an environment that promotes creativity and free-thinking. 

At DevGrid we offer:

• A chance to work on exciting international projects.

• Flexibility on how you do your work, we focus on delivery and not time spent at a desk.

• We encourage you to be a problem solver and not a coder.

• We help you build your skills by supporting you to attend conferences, book clubs and allocating time for research on a subject of your own choosing.

• We don't believe in titles, we all do our best to complete the task at hand.

• We reward your hard work - regular work assessment with bonuses and appraisals.