Data Engineer
India - Hyderabad
Highspot
About the Data & Services Engineering (DSE) TeamThe Data & Services Engineering (DSE) Team is on the mission of building innovative solutions to drive growth and adoption of the Highspot platform, drive operational efficiency to scale our customer services organization, generate impactful analytics insights we can share with customers and industry, integrate & share curated data from our data warehouse to empower data-driven decision making across the organization.
About The RoleAs a Data Engineer, you will be responsible for the end-to-end data pipeline, ensuring the reliability, efficiency, and scalability of our data systems. You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to develop robust data solutions that empower data-driven decision-making.
What You'll Do
- Create optimal data pipeline architecture
- Develop, and maintain end-to-end scalable data infrastructure and pipelines.
- Identify, design, and implement process improvements, automating manual processes and optimizing data delivery.
- Assist internal stakeholders with data-related technical issues and support their data infrastructure needs.
- Develop data tools for analytics and data scientists, contributing to product innovation.
- Collaborate with data and analytics experts to enhance functionality in data systems.
- Design and implement data models, ensuring integrity and consistency.
- Identify and resolve performance bottlenecks, optimizing queries and processing.
- Implement data governance best practices for quality, security, and compliance.
- Stay informed about emerging technologies, contribute to tool selection, and enhance data infrastructure.
- Create and maintain comprehensive documentation for data engineering processes and workflows.
- Drive the team's data strategy, technical roadmap, and data storage solutions.
- Empower the team for self-servicing and efficient troubleshooting.
Your Background
- Bachelor’s degree or equivalent experience.
- 3+ years experience in product engineering industry.
- 2+ years of experience using SQL in an advanced capacity in query authoring, tuning, and identifying useful abstractions.
- 3 years of hands-on experience in Python, demonstrating proficiency in data wrangling and object-oriented programming
- Expertise in designing, creating, managing, and utilizing large datasets.
- Ability to build efficient, flexible, extensible, and scalable ETL and reporting solutions.
- Root cause analysis experience on internal and external data and processes.
- Cloud-based database platforms experience, preferably Snowflake.
- 2+ years of git experience for version control and collaboration.
- 2+ years of experience working with AWS cloud technology.
- 2+ years of experience working with workflow management platforms like airflow/dagster
- 1+ years experience using Tableau to build impactful reports and dashboards
- Experience working with dbt is a plus
- Strong analytical and problem-solving skills.
- Cross-functional team collaboration experience in a dynamic environment.
- Proven track record of navigating ambiguity, prioritizing needs, and solving impactful business problems.
- Excellent written and verbal communication skills for technical and non-technical audiences.
- Empathy-driven, supporting team success.
- Remote work experience with a U.S.-based team is preferred.
Equal Opportunity StatementWe are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of age, ancestry, citizenship, color, ethnicity, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or invisible disability status, political affiliation, veteran status, race, religion, or sexual orientation.
Did you read the requirements as a checklist and not tick every box? Don't rule yourself out! If this role resonates with you, hit the ‘apply’ button.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture AWS Dagster Data governance Data strategy Data warehouse dbt Engineering ETL Git OOP Pipelines Python Security Snowflake Spark SQL Tableau
Perks/benefits: Flex hours Medical leave
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Business Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs