Principal Data Engineer
Serbia - Belgrade
Applications have closed
project44
Manage your freight tracking in real-time with project44's supply chain visibility platform. Schedule a demo today.Why project44?
At project44 we’re on a mission - to make supply chains work.
project44 optimizes the movement of products globally, delivering better resiliency, sustainability, and value for our customers. As the supply chain connective tissue, we operate the most trusted end-to-end visibility platform that tracks more than 1 billion shipments annually for the world’s leading brands. The undisputed leader in the market, project44 was named the Leader in the Gartner Magic Quadrant, #1 in FreightWaves’ FreightTech 25, and the Customer’s Choice in Gartner Peer Insights’ Voice of the Customer report. project44 is headquartered in Chicago with a diverse and fast-growing, global workforce.
If you’re eager to be part of a winning team that works together to solve some of the most challenging supply chain challenges every day, let’s talk.
About the role:
As a Principal Data Engineer at project44, you'll have opportunities to work on ETL pipeline, support & solve various data integration challenges and improve overall data warehouse and data lake processing.
What you'll be doing:
- Design and development ETL/ELT using Python/Java with Snowflake, Postgres and other data stores. Be able to develop & automate a project through its entire lifecycle
- Knowledge in Data Warehouse/Data Mart design and implementation. Be able to develop a project through its entire lifecycle
- Build distributed, reusable, and efficient backend ETLs
- Implementation of security and Data protection
- Providing guidance on new technologies and continuous improvement in best practices
- Researching, implementation and development of software development tools
- Understand repeatable automated processes for building the application, test it, document it, and deploy it at scale
- Work collaboratively with insights and data science teams to understand end user requirements to provide technical solutions and for the implementation of new features and data pipelines
- Establish quality processes to deliver a stable and reliable solution
- Efficient in writing complex SQL, stored procedures in Snowflake, Postgres, BigQuery
- Preparing documentation (Data Mapping, Technical Specifications, Production Support, data dictionaries, test cases, etc.) for all projects
- Coach junior team members and help your team to continuously improve by contributing to tooling, documentation, and development practices
You could be a great fit if you have:
Experience & Education
- 8+ Years of experience in leading Data Engineering efforts
- 3+ Years of experience in Snowflake, Oracle and knowledge in No SQL database like MongoDB
- 3+ Years of experience in Python/Java
- 3+ Years of experience in ETL Developer role with deep knowledge of data processing tools like Airflow, Argo workflow
- 4+ yrs experience with data engineering and operations, including administering production-level, always-on, high throughput, complex OLTP RDBMS
- Strong experience in building data warehouse solutions and Data Modeling
- Strong ETL performance-tuning skills and the ability to analyze and optimize production volumes and batch schedules
- Experience with ETL, GCP, Unix/Linux, Helm Charts as well as Git or other version control systems
- Expertise in operational data stores and real time data integration
- Expert level skill in modeling, managing, scaling and performance tuning high-volume transactional database
- Bachelor's Degree in computer science or equivalent experience
Technical Skills
- Strong programming/scripting knowledge in building and maintaining ETL using Java, SQL, Python, Bash, Go
- In-depth hands-on knowledge of public clouds - GCP(preferred)/AWS, PostgreSQL (version 9.6+), ElasticSearch, MongoDB, MySQL/MariaDB, Snowflake, BigQuery
- Participate in an on-call rotation to mitigate any data pipeline failures
- Strong experience with Kafka or equivalent event/streaming based systems
- Experience with Docker, Kubernetes
- Develop and deploy CICD pipelines for Data Engineering
- Experience and knowledge of optimizing database performance and capacity utilization to provide high availability and redundancy
- Proficiency with high volume OLTP Databases and large data warehouse environments
- Ability to work in a fast-paced, rapidly changing environment
- Understanding of Agile and its implementation for Data Warehouse Development
Professional Skills/Competency
- Focus on development/ improvement of framework to support repeatable and scalable solutions
- Demonstrates excellent communication and interpersonal skills; able to communicate clearly and concisely
- Takes initiative to recommend/ develop innovative approaches to getting things done
- Is a team player and encourages collaboration
Diversity & Inclusion
At project44, we're designing the future of how the world moves and is connected through trade and global supply chains. As we work to deliver a truly world-class product and experience, we are also intentionally building teams that reflect the unique communities we serve. We’re focused on creating a company where all team members can bring their authentic selves to work every day.
We’re building a company that every one of us at project44 is proud to work for, and our journey of becoming a more diverse, equitable and inclusive organization, where all have a sense of belonging, is shaped through the actions of our leadership, global teams and individual team members. We are resolute in our belief that each team member has an equal responsibility to mold and uphold our culture.
project44 is an equal opportunity employer seeking to enrich our work environment by creating opportunities for individuals of all backgrounds and experiences to thrive. If you share our values and our passion for helping the way the world moves, we’d love to review your application!
For any accommodation needed during the hiring process, please email recruiting@project44.com. Even if you don’t meet 100% of the above job description you should still seriously consider applying. Studies show that you can still be considered for a role if you meet just 50% of the role’s requirements.
More about project44
Since 2014, project44 has been transforming the way one of the largest, most important global industries does business. As transportation and logistics continues to evolve and customer expectations around delivery become more demanding, industry technology must rise to the occasion. In just a few short years, we’ve created a digital infrastructure that eliminates the inefficiencies caused by dated technology and manual processes. Our Advanced Visibility Platform is used by the world’s leading brands to track shipments, collaborate with supply chain partners, drive operational efficiencies, and create outstanding customer experiences.
#LI-Hybrid
Tags: Agile Airflow AWS BigQuery Computer Science Data pipelines Data warehouse Docker Elasticsearch ELT Engineering ETL GCP Git Helm Kafka Kubernetes Linux MariaDB MongoDB MySQL Oracle Pipelines PostgreSQL Python RDBMS Security Snowflake SQL Streaming
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open AI Engineer jobs
- Open Senior Data Architect jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs