Senior Data Engineer (remote)
Lisbon, Portugal
Applications have closed
Penguin Formula
Penguin Fomrula helps companies looking for IT professionals to accomplish IT projects. Nearshore, Offshore, On-site, Custom-made. Penguin Formula language is global and its people have it in their DNA.Company Description
We Cook iT is an international software house that delivers software development to its corporate customers by providing highly skilled, communicative IT professionals to build their customized products through outsourcing, nearshoring and turn-key projects’ solutions.
How do we differentiate ourselves? By investing in the professional growth and personal care of our software developers. We provide them with a premium service so that they can do the same for our customers.
Our talented team holds software engineers and sales experts, spread across offices in Europe and South America, and we represent a go-getting and driven company who aims to be an inspiring software house, knowing our future relies on IT.
We Cook iT stand for growth, support, dynamic, companionship and communication and we’re looking for a [main characteristic] [position] to join team We Cook iT. Our head office is located in Portugal in the heart of Lisbon (Avenida da Liberdade) and we work mainly for the European market.
Job Description
- responsible for expanding and optimizing our data and data pipeline architecture
- optimizing the data flow and collection for cross-functional teams
- building data pipelines as development of processing (transforming, aggregating, wrangling) data
- optimizing data systems and building them up from the ground
- Coaching of junior engineers
Qualifications
- Multi-year experience working in a data engineer or software developer role and/or demonstrable involvements in / contributions to open source projects.
- Practical experience in at least 2 of the following programming languages: Python, Scala, Java, Kotlin, Go, Rust, C#, F#, C, C++.
- Considerable experience with modern programming paradigms, e. g. functional, event-driven, asynchronous, component-oriented, …
- Ability to sketch software and system architectures on the whiteboard.
- Aware of and experienced in applying best practices for distributed systems.
- Demonstrable expertise regarding some components like Spark, Spark Streaming, Kafka, Flink, ElasticSearch, Prometheus, Cassandra, Hive, Kudu, … from a data engineer and software engineer perspective.
- Experience with building and maintaining ‘big data’ data pipelines, architectures, data sets and tools like Airflow, Azure Data Factory, NiFi, Flume, Beam, etc.
- Used to applying CI/CD and automation best practices and tools like Jenkins, Github Actions, ArgoCD, Ansible, Terraform, Helm, …
- Take technical responsibility, initiative, leadership in projects, taking the role of a main data/software engineer.
- Closely collaborate with data/software architects, challenge their architecture and design drafts, refine them together with them and bring them to Prod maturity.
- Experienced in and motivated by navigating in open source community contexts.
Bonus points for practical experience with any of
- Implementing libraries and frameworks for internal users (as opposed to only applications)
- Writing k8s operators
Additional Information
If you are looking for a fast-paced multinational company and have a desire to be part of the exciting state-of-the-art projects across Europe, send us your application in English.
We’re looking forward to hearing from you!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Ansible Architecture Azure Big Data Cassandra CI/CD Data pipelines Distributed Systems Elasticsearch Flink GitHub Helm Kafka Open Source Pipelines Python Rust Scala Spark Streaming Terraform
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs