Senior Data Engineer
Belgrade, serbia, Serbia
CREATEQ
- Working with stakeholders to grow the amount and kinds of customer-defined targetings we can calculate in real-time
- Develop new features for our in-house streaming key/value DBs
- Improve resource utilization across all stages of our data pipelines, from validation and ingestion to storage to dynamic queries
- Collaborate with developers and stakeholders to design services in order to meet product and business requirements
Requirements
- Fluent in Go, C++ or similar languages
- You have significant exposure to Kafka as data processing system
- Strong experience in working within distributed, event-driven system with a focus on real-time processing and observability
- Handled several high-dimensional, high-cardinality, from high-level entity modeling and pipeline design to low-level problems of representation and query access patterns
- You have seen through an entire program development lifecycle, from feature conception to deployment and monitoring
We use the following tech-stack:
- Spark and HDFS on Cloudera
- Java 11+ and Go services running via on-prem Kubernetes
- protobuf and gRPC
- Kafka 3, with Kafka Streams and Sarama
- LSM-based key/value stores e.g. RocksDB
- OLAP-focused relational stores e.g. ClickHouse
Benefits
- A chance to be a part of a casual but professional environment where you will have a safe place to try, fail and learn
- Have full ownership over your code
- Coaching from our tech leads to advance your soft and technical skills and set your own development path
- Defined and organized the onboarding process for both, the company and the project
- Competitive compensation depending on experience and skills
- Private pension and medical insurance for you and your family. Also, maternity and sick leave are 100% paid
- Sport clubs – from fishing to basketball, whatever rocks your boat
- Awesome referral fees - because great people know great people
- Work-life balance – this is the company that really supports your professional, family and personal goals
- Freedom to decide how you want to work - partly or fully remote or from our offices.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Data pipelines HDFS Java Kafka Kubernetes OLAP Pipelines Spark Streaming
Perks/benefits: Career development Competitive pay Health care Medical leave
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Intern jobs
- Open Data Engineer II jobs
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Marketing Data Analyst jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Research Scientist jobs
- Open Principal Data Scientist jobs
- Open Big Data Engineer jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs