[CSA] Big Data Engineer
Posted 7 months ago
Acronis is developing bigdata platform for malicious threats analysis, detection and classification. We use proven ML algorithms and flexible architecture to make the solution easily adjustable to new threats and configurable for the end user.
As a Big Data Engineer, you will be building, improving, monitoring and managing our scalable Big Data infrastructure and tools.
- Design and develop system backend components (data storage layer) according to business requirements and requests.
- Build highly scalable, robust and fault-tolerant systems.
- Monitor, optimize and re-design the architecture to maximize performance of systems.
- Read, handle, process, transform and load data to selected frameworks according to requirements and requests.
- Perform quality assurance for developed components.
- Support the core team and work closely with the engineering team to integrate your work into our production systems.
- Create and maintain documentation around features and configurations.
- 2-3 years of experience in Big Data systems, data engineering, pipelines and data processing.
- Knowledge and hands on experience in working with Spark, Hadoop (HDFS, Yarn, Hive, MapReduce) and/or Kafka ecosystem.
- Knowledge and hands on experience in working with NoSQL databases such as MongoDB, Cassandra and/or HBase.
- Experience in programming in Python, Scala and/or Java.
- Knowledge of ETL/ELT and reporting/analytic tools and environments and performance tuning.
- Experience in utilization of Big Data platform and efficient processing large amounts of structured and unstructured data.
- Strong communication skills.
- Passion for crafting and shipping robust software solutions.
More AI/ML/Data Science position highlights
- Explore open Sr Data Engineer Jobs
- Explore open Data Operations Analyst Jobs
- Explore open Head of Data Science Jobs
- Explore open Applied Data Scientist - B2B Sales Incrementality Jobs
- Explore open Data Scientist II Jobs
- Explore open Senior Marketing Data Analyst Jobs
- Explore open Lead Data Analyst Jobs
- Explore open Senior Machine Learning Scientist Jobs
- Explore open Data Science Manager Jobs
- Explore open Data Science Intern Jobs
- Explore open Data Scientist, Machine Learning Jobs
- Explore open Data Engineer: Business Intelligence Jobs
- Explore open Software Engineer - Machine Learning Jobs
- Explore open BI Data Analyst Jobs
- Explore open Data Engineer - Toronto Hub Jobs
- Explore open Manager, Data Engineering Jobs
- Explore open Software Development Engineer - Machine Learning Jobs
- Explore open Data Engineer III Jobs
- Explore open Senior Data Engineer - Toronto Hub Jobs
- Explore open Data Science Consultant Jobs
- Explore open Senior Data Engineer - Streaming Jobs
- Explore open Financial Data Analyst Jobs
- Explore open Data Engineering Manager (Data Science & Analytics) Jobs
- Explore open Computer Vision Engineer Jobs
- Explore open Business Data Analyst Jobs
- Explore open Airflow-related jobs
- Explore open Economics-related jobs
- Explore open Looker-related jobs
- Explore open PyTorch-related jobs
- Explore open Consulting-related jobs
- Explore open Kubernetes-related jobs
- Explore open Healthcare-related jobs
- Explore open Travel-related jobs
- Explore open Data Mining-related jobs
- Explore open Open Source-related jobs
- Explore open Pandas-related jobs
- Explore open Data Warehousing-related jobs
- Explore open NLP-related jobs
- Explore open Distributed Systems-related jobs
- Explore open Computer Vision-related jobs
- Explore open Scikit-Learn-related jobs
- Explore open Linux-related jobs
- Explore open BigQuery-related jobs
- Explore open Data pipelines-related jobs
- Explore open NoSQL-related jobs
- Explore open MySQL-related jobs
- Explore open NumPy-related jobs
- Explore open Keras-related jobs
- Explore open MongoDB-related jobs