Big Data Developer - R202

Bangarapet, Karnataka, India

Riskinsight Consulting

View company page

  • We are seeking a skilled Data Engineer with 4-8 years of experience, proficient in Big Data technologies and data processing frameworks.
  • The ideal candidate will have strong expertise in Hadoop ecosystem components such as HDFS, HiveQL, and experience in developing and optimizing data processing workflows using PySpark.
  • Proficiency in SQL for data manipulation and querying, coupled with hands-on experience in Linux Shell scripting for automation and job scheduling, is essential for this role.
  • Candidates should demonstrate a solid understanding of Python programming language and its libraries for data manipulation, analysis, and scripting tasks.
  • Responsibilities include designing, implementing, and maintaining scalable data pipelines, as well as performing data wrangling and transformation tasks to ensure data quality and reliability.
  • Strong problem-solving skills, attention to detail, and the ability to work effectively in a fast-paced environment are essential qualities for success in this role.
  • Experience with version control systems such as Git and knowledge of CI/CD pipelines would be beneficial.
  • The candidate should possess excellent communication skills and the ability to collaborate effectively with cross-functional teams to deliver high-quality solutions on time.
  • A proactive approach to learning and staying updated with the latest trends and technologies in Big Data and analytics is highly desirable.
Apply now Apply later
  • Share this job via
  • or

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: Big Data CI/CD Data pipelines Data quality Git Hadoop HDFS HiveQL Linux Pipelines PySpark Python Shell scripting SQL

Region: Asia/Pacific
Country: India
Job stats:  1  0  0

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.