GCP Data Engineer Senior Consultant
Bengaluru, KA, India
PradeepIT Consulting Services Pvt Ltd
PradeepIT, supported by Asia's largest tech professional network, revolutionizing global talent acquisition. Discover the potential of hiring top Asian tech talents at ten times the speed, starting today!3-5years - GCP Data Engineer - Headcount: 20
6-8years - GCP Lead Data Engineer - Headcount: 8
8-12years GCP Architect - Headcount: 4
FAQ:
1. How much percentage you spend writing Python script for data cleanup, or any other work
2. Big Query - which tool you have used?
3. Have you worked on Batch processing of data or Streaming? How much exp: Batch processing, How much on Streaming
4. Have you worked on workflow creation using Airflow? Yes/No
5. SQL rating? then Have you worked on SQL query tuning? Yes/No
6. Which domain you have worked? Note down the domain
7. Have to created Data pipeling for ETL end to end? years of experience?
Job Description
Minimum 12 months of core experience in Airflow (writing Directed Acyclic Graphs DAGs) Good to have
Minimum 12 months of core experience in Big Query, Composer, and development of pipelines (batch or streaming) - MUST
Minimum 6 months of experience in Python - MUST
Very strong in SQL (at least 4 years of experience in writing SQLs) - MUST
Strong communication skills - MUST
Knowledge in Pub/Sub would be an advantage - Good To Have
Knowledge of the telecom domain would be an advantage - Good To Have
- Have experience with Data Fusion or Equivalent, Big Query or Equivalent, SQL server, scripting in Java/Python that works well in GCP products, and their respective practices. Python experience is a plus.
- Develop data ETL pipelines that meet both functional and non-functional requirements, including performance, scalability, availability, reliability, and security.
- Have experience with writing code in Java, to work on data extracts that require cleanup.
- Have a working knowledge of XML, JSON, and other forms of data streaming artifacts and related technologies in a Java/Python environment.
- Have strong written and verbal communication skills
- Able to multi-task on various streams of the entire data process.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow BigQuery ETL GCP Java JSON Pipelines Python Security SQL Streaming XML
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Engineer II jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Research Scientist jobs
- Open Business Intelligence Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Business Data Analyst jobs
- Open Principal Data Scientist jobs
- Open Sr Data Engineer jobs
- Open Data Science Manager jobs
- Open Data Science Intern jobs
- Open Lead Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Junior Data Scientist jobs
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst II jobs
- Open Software Engineer, Machine Learning jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Engineer III jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Snowflake-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs
- Open RDBMS-related jobs