Senior Data Engineer
Mumbai, Maharashtra, India
Applications have closed
About the Role
As one of the key members of the engineering team, you will have the unique opportunity to redefine the architecture of our suite of products. You will get to work directly with our founding team to deliver the most valuable and joyful experience to our customers. If you are looking to make a real impact on real people’s lives and accelerate your career to new heights in the meantime, then this is the perfect opportunity for you.As we continue to onboard new clients, there is a substantial amount of data for our client that requires ETL operations. You will be creating custom scripting to migrate client’s proprietary data into CurbWaste and provide the most optimal onboarding experience for our customers. You will start building the directory for repetitive tasks related to data management and integration with accounting systems need to be converted to automated scripts.
About Us
We are an early stage vertical SaaS business dedicated to bringing the most innovative technology to the historically underserved Waste Management Industry. We care deeply about the hard working, dedicated, and humble people of the Waste Management industry and will stop at nothing to ensure that they get the most value technology can offer. We lean on each other to deliver the best value to our customer and we constantly challenge each other to be the best version of ourselves every day. We settle at nothing short of being the best at what we do.
Requirements
What you will do
- Debottlenecking database queries
- Designing reporting server and implementation
- Designing APIs to deliver reporting data
- Data migration scripting
- Integration and syncing with accounting systems and backups
- Modification of data in real time to correct data based user errors
What you will need
- Experience in AWS technologies such as Kinesis, Lambda, EC2, Redshift, RDS, Cloud formation, EMR, AWS S3, AWS Analytics
- Experience in Database design & management for data-heavy product/s - NoSQL & SQL DBs - MongoDB, PostgreSQL, Cassandra, DynamoDB, MySQL
- Prior experience of design and deployment of a production multi-tenant product architecture
- Experience with at least one of the following languages Scala, Python, NodeJs or other
- Experience with designing, developing, and implementing complex integration for end-to-end solutions at a middleware and app level with focus on performance optimization - Kafka, BigQuery, Apache Spark, NATS streaming
- Strong experience with integration of diverse data sources (batch and real time) in the cloud
- Prior experience in leading the design and sustainment of data pipelines and data storage
- Experience with design and automation of ETL\ELT processes & tools - Apache Airflow, and other toolsets
- Experience with any open source reporting tools such as Apache Superset
- Prior experience in notifications delivery tools - FCM
- Experience with data storage and backup strategies with custom policiesPrior experience of IoT and streaming is a plus
Benefits
What We Offer
This is not just a job. This is a career, a chance to make a direct impact. Here’s how we help:
- Flextime, recognition, and support for autonomous work: Flexible time off with ample learning and development opportunities to continue growing your career.
- Competitive salary
Our Mission
We aim to change the way waste companies run their business. We are a software founded by haulers and built for haulers. We care about the environment and want to play a positive role in the future of the waste industry. Software helps create solutions and we are focused on being the leaders in change.
At CurbWaste we celebrate individuality and uniqueness. We believe that the convergence of fresh perspectives and experiences from all walks of life is what makes our product and culture so great. We strongly encourage people from underrepresented groups to apply. We do not discriminate against employees based on race, color, religion, sex, national origin, gender identity or expression, age, disability, pregnancy (including childbirth, breastfeeding, or related medical condition), genetic information, protected military or veteran status, sexual orientation, or any other characteristic protected by applicable federal, state or local laws.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture AWS BigQuery Cassandra Data management Data pipelines DynamoDB EC2 ELT Engineering ETL Kafka Kinesis Lambda MongoDB MySQL Node.js NoSQL Open Source Pipelines PostgreSQL Python Redshift Scala Spark SQL Streaming Superset
Perks/benefits: Career development Competitive pay Flex hours Flex vacation Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs