Senior Data Engineer
Navi Mumbai, Maharashtra, India
TestbookWelcome to Testbook.com - The most trusted exam preparation Site for competitive exams. Prepare for Exams like Banking, SSC, Railways, GATE, UPSC with 26000+ Mock tests and Live Coaching.
Location: Navi Mumbai,Maharashtra,India
About Us :
The fastest rising startup in the EdTech space, focussed on Engineering and Government Job Exams and with an eye to capture JEE, Medical, UPSC, and international exams.
Testbook is poised to revolutionize the industry. With a registered user base of over 105 lakh students, 300 crore questions solved on the WebApp, and a knockout Android App, Testbook has raced to the front and is ideally placed to capture bigger markets.
Testbook is the perfect incubator for talent. You come, you learn, you conquer. You train under the best mentors and become an expert in your field in your own right. That being said, the flexibility in the projects you choose, how and when you work on them, what you want to add to them is respected in this startup. You are the sole master of your work.
The IIT pedigree of the co-founders has attracted some of the brightest minds in the country to Testbook. A team that is quickly swelling in ranks, it now stands at 550+ in-house employees and hundreds of remote interns and freelancers. And the number is rocketing weekly. Now is the time to join the force.
In this role you will get to:
- Work with state-of-the-art data frameworks and technologies like Dataflow(Apache Beam), Dataproc(Apache Spark & Hadoop), Apache Kafka, Google PubSub, Apache Airflow, and others.
- You will work cross-functionally with various teams, creating solutions that deal with large volumes of data.
- You will work with the team to set and maintain standards and development practices.
- You will be a keen advocate of quality and continuous improvement.
- You will modernize the current data systems to develop Cloud-enabled Data and Analytics solutions
- Drive the development of cloud-based data lake, hybrid data warehouses & business intelligence platforms
- Improve upon the data ingestion models, ETL jobs, and alerts to maintain data integrity and data availability
- Build Data Pipelines to ingest structured and Unstructured Data.
- Gain hands-on experience with new data platforms and programming languages
- Analyze and provide data-supported recommendations to improve product performance and customer acquisition
- Design, Build and Support resilient production-grade applications and web services
Who you are:
- 4+ years of work experience in Software Engineering and development.
- Very strong understanding of Python & pandas library.Good understanding of Scala, R, and other related languages
- Experience with data transformation & data analytics in both batch & streaming mode using cloud-native technologies.
- Strong experience with the big data technologies like Hadoop, Spark, BigQuery, DataProc, Dataflow
- Strong analytical and communication skills.
- Experience working with large, disconnected, and/or unstructured datasets.
- Experience building and optimizing data pipelines, architectures, and data sets using cloud-native technologies.
- Hands-on experience with any cloud tech like GCP/AWS is a plus.
Apply to this job
* Salary range is an estimate based on our salary survey at salaries.ai-jobs.net
Perks/benefits: Startup environment
Other jobs like this
Senior Data Engineer - Apache Spark (Java/Scala) (Bangkok based, relocation provided)Agile Big Data Business Analytics Data Warehousing Distributed Systems Engineering Hadoop Linux Python Scala +3
Explore more AI/ML/Data Science career opportunities
Find open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general, filtered by job title or popular skill, toolset and products used.
- Open Data Engineer (Remote) jobs
- Open Data Engineer II jobs
- Open Principal Data Scientist jobs
- Open Computer Vision Engineer jobs
- Open Junior Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Senior Data Analyst (Bangkok Based, relocation provided) jobs
- Open Research Scientist, Computer Vision jobs
- Open Marketing Data Analyst jobs
- Open Data Scientist II jobs
- Open Autonomous Vehicle System Test Specialist jobs
- Open Data Engineering Lead jobs
- Open Senior Data Architect jobs
- Open Data Scientist (Remote) jobs
- Open Data Analyst (Remote) jobs
- Open Lead Data Analyst jobs
- Open Research Scientist, NLP jobs
- Open Head of Data Science jobs
- Open Senior Marketing Data Analyst jobs
- Open Junior Data Engineer jobs
- Open Associate Data Analyst- Customer Experience Group | Bangkok-based jobs
- Open Senior Data Engineer (Remote) jobs
- Open Sr. Data Analyst jobs
- Open Senior Machine Learning Scientist jobs
- Open Data visualization-related jobs
- Open TensorFlow-related jobs
- Open Excel-related jobs
- Open Business Intelligence-related jobs
- Open Snowflake-related jobs
- Open Redshift-related jobs
- Open Streaming-related jobs
- Open Hadoop-related jobs
- Open Economics-related jobs
- Open PyTorch-related jobs
- Open Azure-related jobs
- Open GCP-related jobs
- Open Kafka-related jobs
- Open Docker-related jobs
- Open Kubernetes-related jobs
- Open Git-related jobs
- Open NLP-related jobs
- Open BigQuery-related jobs
- Open Consulting-related jobs
- Open Pandas-related jobs
- Open Data Warehousing-related jobs
- Open Computer Vision-related jobs
- Open Data Mining-related jobs
- Open NoSQL-related jobs
- Open Classification-related jobs