Senior Data Engineer
Remote job
Intetics
Intetics is a top custom software development company focused on creation and operation of distributed development teams, software product quality assessment, and “all-things-digital” solutions.We are inviting Data Analyst to join Intetics — an international IT-company with 24 years of experience in developing IT- solutions for 300+ clients globally.
You will be the first senior hire in our Data Engineering team and be part of the broader and fast-growing Data department. You are looking to take the next step in your career with increased responsibility and be part of our incredible growth story. To do so, you are senior enough to own projects, work with senior stakeholders and meet tight deadlines.
You will formulate the strategy for our data collection, data processing and data stores/infrastructure, and own the implementation and the maintenance of these designs, ensuring continued high performance and availability. In short, you will work with our Product, Engineering, and Data teams.
About the project:
The project is a BI Solution based on the AWS cloud platform and processing 2 terabytes of data per week.
Project Stack: Data Lake, DWH, Data Analytics in AWS.
Responsibilities:
● Build and maintain Data Pipelines that process and clean heterogeneous data sources (internal and external, incl. 3rd party APIs);
● Manage our Data Lake (AWS s3);
● Set up and manage our Data Warehouse (AWS Redshift);
● Support the Data team by ensuring top-notch data accessibility;
● Work hand-in-hand with our DevOps team to cost-optimize our data usage;
● Work closely with Product, Engineering and Data leadership to make sound technical decisions across the entire data ecosystem;
● Build systems to track data quality and consistency, ensuring that our data is accurate and up-to-date;
● Implement monitoring tools to detect issues and measure the performance of Data Pipelines;
● Establish, maintain and monitor information security controls over Data Pipelines, Data Lake, and Data Warehouse;
● Become the Subject Matter Expert for all data engineering-related topics;
● Keep track of industry trends, best practices, and technologies to continually improve our technology (and ourselves!);
● Contribute to the hiring, mentorship, and management of junior data engineers (as the Data team expands).
Requirements
● 4-5 years of experience in Data Engineer role;
● 2+ years of experience working with ETL/ELT with large amount of data (using Python & SQL);
● 2+ years of experience with OOP (python);
● Expert knowledge of SQL and RDBMS concepts;
● Advanced working knowledge of cloud data architectures (preferably AWS s3, AWS Redshift, AWS Glue, Kinesis and RDS on AWS);
● Experience with job schedulers (e.g. Airflow);
● Knowledge of container technologies (Docker, Kubernetes) and CI pipelines (GitHub Actions, Jenkins);
●Strong knowledge of best practices for data engineering;
● Good English communication skills and ability to perform in fast-paced and multicultural Environment.
Nice to have:
● General Data Science knowledge (basic AI and ML concepts);
● Experience in fintech, especially in the credit/lending space;
● Experience working in agile environments (we recently moved from Kanban to Scrum).
Tags: Agile Airflow APIs AWS Data Analytics Data pipelines DevOps Docker ELT Engineering ETL FinTech GitHub Kanban Kinesis Kubernetes Machine Learning OOP Pipelines Python RDBMS Redshift Scrum Security SQL
Perks/benefits: Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs