Principal Data Engineer - AWS
Islamabad, Federal Territory
NorthBay Solutions
Get access to all of our AWS best practices and insights. Subscribe NowWe're seeking a seasoned Principal Data Engineer with a track record of 8 to 10 years in the field, with a specialization in AWS, to join our dynamic team of analytics experts. This role presents an exciting opportunity for an individual who thrives on solving complex challenges spanning a diverse array of technologies. If you're someone who revels in experimentation and is eager to push the boundaries of your skills, we want to hear from you.
As a Principal Data Engineer, you'll be at the forefront of shaping and maintaining data analytic roadmaps and infrastructures that closely align with our business and technology objectives. Your innate curiosity and enthusiasm for uncovering insights buried within datasets will be invaluable as you collaborate across functional areas to drive actionable outcomes.
Required Skills and Qualifications:
- Strong SQL writing skills
- Proficiency in Python, PySpark, and Delta Lake is a must
- Experience with streaming ingestion using AWS Kinesis
- Familiarity with specialized data architecture concepts (e.g., data lake, lake house, data fabric, data mesh, etc.)
- Expertise in data engineering on the Amazon Cloud platform
- Demonstrated proficiency with AWS services such as S3, Lambda, EC2, Redshift/Redshift Spectrum, Glue, EMR, Athena, MSK, DMS, SSM, EventBus, Lake Formation, SageMaker, etc.
- In-depth understanding of data warehousing, data modeling techniques, and ETL processes
- Ability to work with large-scale datasets, structured and unstructured alike
- Experience in delivering CI/CD and DevOps capabilities in a data environment
- Proficient in Jira and Agile development methodologies
- Knowledge of industry-wide visualization and analytics tools (e.g., AWS QuickSight, Tableau, etc.)
- Strong interpersonal skills and a positive attitude
- Openness to learning new technologies and a passion for technology
Responsibilities:
- Develop and maintain data pipelines using ETL processes
- Ensure adherence to data security, privacy best practices, access control, data versioning, and regulatory compliance within AWS environments
- Collaborate with the data science team to implement data analytics pipelines
- Work closely with DevOps professionals to deploy AWS-based solutions ensuring reliability, scalability, and performance optimization
- Analyze various data stores to derive valuable insights
- Explore alternatives for data storing and processing to implement streamlined solutions
- Translate business requirements into technical specifications and supervise the implementation of AWS-based solutions
- Create and deploy scalable, secure, and efficient AWS architectures to support machine learning initiatives
- Effectively communicate with stakeholders, prioritize tasks, solve problems, and build interpersonal relationships
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred
- 8-10 years of experience in data engineering with a focus on AWS technologies
- Proven ability to work in a team environment and take initiative in problem-solving
- Strong analytical and problem-solving skills
- Excellent written and verbal communication skills
If you're driven by the challenge of working with intricate data problems and are eager to push the boundaries of your skills in a collaborative environment, we encourage you to apply for this role. Join us in our mission to leverage data analytics for actionable insights and innovation.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Athena AWS CI/CD Computer Science Data Analytics Data pipelines Data Warehousing DevOps EC2 Engineering ETL Jira Kinesis Lake Formation Lambda Machine Learning Pipelines Privacy PySpark Python QuickSight Redshift SageMaker Security SQL Streaming Tableau
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Intern jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open LLMs-related jobs
- Open APIs-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs