Senior Data Engineer

Remote job

Applications have closed

Intetics

Intetics is a top custom software development company focused on creation and operation of distributed development teams, software product quality assessment, and “all-things-digital” solutions.

View company page

We are inviting Data Analyst to join Intetics — an international IT-company with 24 years of experience in developing IT- solutions for 300+ clients globally.

You will be the first senior hire in our Data Engineering team and be part of the broader and fast-growing Data department. You are looking to take the next step in your career with increased responsibility and be part of our incredible growth story. To do so, you are senior enough to own projects, work with senior stakeholders and meet tight deadlines.

You will formulate the strategy for our data collection, data processing and data stores/infrastructure, and own the implementation and the maintenance of these designs, ensuring continued high performance and availability. In short, you will work with our Product, Engineering, and Data teams.


About the project:

The project is a BI Solution based on the AWS cloud platform and processing 2 terabytes of data per week.

Project Stack: Data Lake, DWH, Data Analytics in AWS.


Responsibilities:

● Build and maintain Data Pipelines that process and clean heterogeneous data sources (internal and external, incl. 3rd party APIs);

● Manage our Data Lake (AWS s3);

● Set up and manage our Data Warehouse (AWS Redshift);

● Support the Data team by ensuring top-notch data accessibility;

● Work hand-in-hand with our DevOps team to cost-optimize our data usage;

● Work closely with Product, Engineering and Data leadership to make sound technical decisions across the entire data ecosystem;

● Build systems to track data quality and consistency, ensuring that our data is accurate and up-to-date;

● Implement monitoring tools to detect issues and measure the performance of Data Pipelines;

● Establish, maintain and monitor information security controls over Data Pipelines, Data Lake, and Data Warehouse;

● Become the Subject Matter Expert for all data engineering-related topics;

● Keep track of industry trends, best practices, and technologies to continually improve our technology (and ourselves!);

● Contribute to the hiring, mentorship, and management of junior data engineers (as the Data team expands).


Requirements

● 4-5 years of experience in Data Engineer role;

● 2+ years of experience working with ETL/ELT with large amount of data (using Python & SQL);

● 2+ years of experience with OOP (python);

● Expert knowledge of SQL and RDBMS concepts;

● Advanced working knowledge of cloud data architectures (preferably AWS s3, AWS Redshift, AWS Glue, Kinesis and RDS on AWS);

● Experience with job schedulers (e.g. Airflow);

● Knowledge of container technologies (Docker, Kubernetes) and CI pipelines (GitHub Actions, Jenkins);

●Strong knowledge of best practices for data engineering;

● Good English communication skills and ability to perform in fast-paced and multicultural Environment.

Nice to have:

● General Data Science knowledge (basic AI and ML concepts);

● Experience in fintech, especially in the credit/lending space;

● Experience working in agile environments (we recently moved from Kanban to Scrum).

Tags: Agile Airflow APIs AWS Data Analytics Data pipelines DevOps Docker ELT Engineering ETL FinTech GitHub Kanban Kinesis Kubernetes Machine Learning OOP Pipelines Python RDBMS Redshift Scrum Security SQL

Perks/benefits: Startup environment

Region: Remote/Anywhere
Job stats:  11  0  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.