Data Engineer Lead
Pasig, Metro Manila, Philippines - Remote
Boldr
We're a global outsourcing company building high-performing teams & custom business solutions in impactful ways to help grow our clients, company & community.WHAT IS YOUR ROLE:
As Boldr’s Data Engineer Lead, you will set up data pipelines architectures, pull data from different data sources and provide ready to use data sets for our analytics team. You would be in charge of the extract-transform-load (ETL) process not only for all of Boldr’s data, but some of our clients’ as well. You will also assure that all the databases that you handle are up to par in terms of performance, integrity and security. You will be supporting our growing analytics practice to create insights for our ever-expanding client base.
WHY DO WE WANT YOU
We are currently looking for impact-driven individuals who are passionate in helping Boldr grow and achieve our Purpose. We expect our Team to become our ultimate partners to success by always giving their 110% in everything, sharing their talents and quirks, and championing our core values: Curious, Dynamic and Authentic.
Responsibilities:
- Lead the design, development, and maintenance of an advanced data pipeline architecture.
- Expertly compile extensive and intricate datasets that align precisely with both functional and non- functional business requirements.
- Spearhead the identification, design, and execution of internal process enhancements, including automating manual tasks, optimizing data delivery, and reimagining infrastructure for enhanced scalability.
- Assume responsibility for overseeing and coordinating the activities and deliverables of the Data Engineering team, providing mentorship and guidance to junior team members.
- Conduct thorough reviews and proficiently manage source code using Git, ensuring high-quality codebase standards.
- Provide expertise in assisting Data Engineers in building the necessary infrastructure for efficient data extraction, transformation, and loading from a diverse range of data sources (e.g., Zendesk, Freshdesk, QuickBooks, Sprout, Kustomer, etc.).
- Author comprehensive database documentation, encompassing data standards, procedures, and definitions for the data dictionary (metadata), contributing to a well-structured data ecosystem.
- Administer access permissions and privileges across all managed databases, upholding robust security practices.
- Collaborate closely with stakeholders and fellow Data Engineers to resolve complex data-related technical challenges and fulfill their evolving data infrastructure needs, demonstrating strong cross-functional teamwork.
Requirements
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- +5 years of experience building and optimizing data pipelines, architectures, and data sets.
- Strong analytic skills related to working with unstructured datasets.
- Intermediate project management and organizational skills.
- + 5 years of experience with data pipeline and workflow management tools, particularly using Airflow and AWS tools.
- Experience with ETL (Extract-Transform-Load), data integration, manipulation, transformation, and cleaning with scripting languages such as Python, Java, etc.
- Experience with AWS cloud services: Lambda, SNS, RDS, Redshift, API Gateway, S3, VPC, etc.
- Experience with Google Cloud Platform.
- Intermediate knowledgeable of data transfer, backup, recovery, security, integrity and SQL
- +5 years of experience with RESTful Services and APIs
- A general understanding of the Philippines Data Privacy Act
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, PHP, etc.
- +3 years programming experience
- Working knowledge with version control tool like Github
- AWS Solutions Architect (Associate) Certification is a must.
- AWS Solutions Architect (Professional) Certification is a plus.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture AWS Data pipelines Engineering ETL GCP Git GitHub Google Cloud Lambda PHP Pipelines Privacy Python RDBMS Redshift Scala Security SQL
Perks/benefits: Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Engineering Manager jobs
- Open Data Manager jobs
- Open BI Analyst jobs
- Open Sr. Data Scientist jobs
- Open MLOps Engineer jobs
- Open Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Product Data Analyst jobs
- Open Big Data Engineer jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Senior Manager, Data Science jobs
- Open Lead Data Analyst jobs
- Open Director, Data Engineering jobs
- Open Data Analytics Engineer jobs
- Open (Senior) Digital Analytics Engineer jobs
- Open Data Engineer (Remote) jobs
- Open Senior Data Architect jobs
- Open Junior Data Engineer jobs
- Open Business Data Analyst jobs
- Open Principal Data Scientist jobs
- Open Clinical Data Manager jobs
- Open Manager, Data Engineering jobs
- Open Lead Machine Learning Engineer jobs
- Open Research Scientist jobs
- Open Excel-related jobs
- Open Data quality-related jobs
- Open Power BI-related jobs
- Open Privacy-related jobs
- Open Business Intelligence-related jobs
- Open APIs-related jobs
- Open Consulting-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open Airflow-related jobs
- Open TensorFlow-related jobs
- Open Data management-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open PhD-related jobs
- Open Scala-related jobs
- Open Kafka-related jobs
- Open Hadoop-related jobs
- Open Snowflake-related jobs
- Open Data warehouse-related jobs
- Open Docker-related jobs
- Open Data governance-related jobs
- Open DevOps-related jobs