Big Data Engineer

We are looking for a bright Big Data Engineer to join our growing engineering team in Athens.

Who We Are
Incelligent provides software solutions to help large corporations achieve digital transformation through the usage of Big Data and ML-powered Analytics.

What You Will Be Doing

• Implementing and maintaining scalable streaming and batch data pipelines over multiple data sources: Our codebase is in Python, Java & Scala, and our infrastructure is based on open-source Apache projects.

• Monitoring existing pipelines, identifying ways of innovating, improving, and resolving problems
• Cooperate with other team members to the architectural design and implementation of data processes.

Requirements

• BSc/ MSc Degree in Electrical & Computer/ Electronic engineering, Computer Science, or other related fields

• Minimum 2 years of experience in data engineering; Strong knowledge of SQL is required

• Minimum 2 years of experience of programming with at least one of Java, Scala, Python languages
• Good command of Spark API; Scala API experience is a plus
• Familiarity with the Hadoop ecosystem, incl. HDFS, Hive, Impala
• Experience with relational databases such as PostgreSQL, MySQL, Oracle

• Experience with development background creating pipelines and complex data transformations and manipulations
  

Nice to have

• Experience with workflow management tools like Airflow, NiFi, etc.
• Experience with modern data architectural and design patterns is a plus.
• Knowledge of Apache Kafka or other message/event queues
• Experience of cloud services (Microsoft Azure, AWS, Google Cloud Platform)
• Experience with Cloudera Distribution is a plus
• Familiarity with Docker and Kubernetes
  

Other qualifications

• Strong oral and written communication skills
• Fluent in English
• Eagerness to learn modern technologies
• Ability to deliver in time-critical situations in an organized way

• Team motivation

Benefits

• Highly competitive salary, reviewed upwards on a regular basis, based on your performance
• Participation in state-of-the-art projects and tech challenges
• Personal and professional development, amongst industry experts and talented people
• Continuous learning, having access to broad resources for professional and personal development
• Friendly environment and fun team members, with fresh ideas
• Modern workspace, at a very good location
• Commitment to Equal Employment Opportunity