Senior Data Engineer
Kraków
We are looking for an exceptional Senior Data Engineer to help us define and build our next generation data platform on top of Google Cloud, guiding its direction and integration within the company.
This platform will support our internal analytics and personalization needs, while enabling future business opportunities.
This role may be for you if...
- You are curious to understand business needs and how to transform those requirements into data.
- You view the present world as a pool of data and believe it is your job to create the tools and platforms needed to process it all.
- You believe in a future where every business is data driven, making insightful decisions based on the data available, rather than being lost and dragged down by it.
- When you hear the words ETL you are curious about the past we are living in since you process everything in real-time, using the latest technology.
- You wonder if you will ever use the challenging algorithms you've learned in your Computer Science background on a day to day basis, or if it was just all for theory.
- You thrive in a fast-paced, highly collaborative team of 3 to 5 engineers.
During a typical week you might ...
- Understand the data sources and map them into respective domains
- Build projects using complex business algorithms and load them in the data warehouse.
- Present a schema management system design at an Engineering-wide architecture review
- Build new data pipelines using DataFlow
- Code data fills in python against Google Cloud Storage and BigQuery
- Investigate, deploy and implement a caching solution for enabling real-time joins of big data sets
- Develop a data quality validation framework used for both testing and real time production data
- Design tools enabling easy-to-use workflows for internal teams using the data platform
We are looking for ...
- 7+ years of experience designing and implementing large scale software
- 4+ years of experience working with Big Data technologies like Apache Beam,DataFlow, BigQuery, Kafka, Airflow and Spark
- Experience designing a real-time Big Data platform
- Experience deploying and managing Big Data infrastructure
- Strong coding ability in an object oriented language (preferably Scala, Python, Java)
- Excellent team player with strong communication skills (verbal and written)
- Enthusiastic about collaborative problem solving
- Bachelor’s degree or better in Computer Science
Extra points if you have ...
Experience with Streamsets, Google BigQuery, Apache NiFi, Looker, Pipeline monitoring tools, Strong SQL and data modelling skills.
OANDA Global Corporation is a diverse and global team with offices around the world. We value the unique skills and experiences each individual brings to OANDA. We are committed to creating and sustaining a collegial work environment in which all individuals are treated with dignity and respect and one which reflects the diversity of the community in which we operate. We provide an inclusive and accessible environment for everyone. Candidates selected for an interview will be contacted directly. If you require accommodation during the recruitment and selection process, please let us know. We will work with you to provide as seamless a recruitment experience as possible.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture Big Data BigQuery Computer Science Dataflow Data pipelines Data quality Data warehouse Engineering ETL GCP Google Cloud Kafka Looker Pipelines Python Scala Spark SQL Testing
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Senior Data Architect jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Manager jobs
- Open Data Quality Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs