Senior Data Engineer
Anywhere, United States
Applications have closed
Who we are:
At Fivestars, our mission is to help businesses and communities thrive by turning every transaction into a relationship. Over 50 million people use Fivestars to get rewarded at more than 14,000 local businesses with one rewards program. Local businesses use Fivestars to bring more customers into their stores with an all-in-one marketing and payments program. Fivestars facilitates over $3 billion in local commerce across its network per year. Fivestars has raised $105 million from HarbourVest, Menlo Ventures, Lightspeed, DCM, Y-Combinator, and others. Together, let’s love local. Visit www.fivestars.com for more information.
Who you are:
As part of the Engineering team at Fivestars, our mission is to deliver solutions that impact and improve the day-to-day lives of small business owners and consumers using our products across our network. In this role, you will be building and delivering highly scalable and reliable systems that drive the experience of thousands of local businesses and millions of consumers.
Do you find data architecture exciting? Does building a new data pipeline or optimizing a data warehouse make you happy? Can you migrate a data store to the cloud, run a few jobs to clean things up, and build a set of processes to keep the data current? Are you comfortable with Terabyte-scale data, optimizing cloud stores, building workflow management systems, AWS, and Python scripting? Can you work closely with business stakeholders to understand their needs and sate those through data solutions? If so, we want you!
What you’ll do:
- Build and maintain cloud-based data infrastructure (Redshift/Presto/Kinesis/Glue/EC2/S3/Lambda etc.)
- Create data pipelines to/from external partners using Python and other tools.
- Establish and use workflow-management tools to orchestrate solutions(Airflow,DBT)
- Write complex SQL queries to extract, transform and load data from various sources.
- Regularly work with Jira, Github, Cloudwatch etc.
- Monitor and improve pipeline and data-warehouse performance.
- Explore new technologies and tools as appropriate and provide recommendations.
- Build strong partnerships with stakeholders in order to influence adoption of infrastructure
What we’re looking for :
- 5+ years of experience and steadily increasing responsibility in a data-engineering function using cloud-based infrastructure.
- Experience creating efficient and scalable pipelines and solutions, preferably in Python.
- Experience in managed services for data ingestion/processing with hands-on experience working in AWS environment and operational experience of Kinesis/Kafka, S3, Glue and Athena.
- Experience with cloud-based data warehousing systems (e.g. AWS Redshift, Snowflake, Google BigQuery)
- Proficient in any flavor of SQL (Postgres preferably) and demonstrable ability in data modeling, ETL development, data warehousing, batch, and real time data processing, query optimization and large scale data storage.
- Experience with API development (GraphQL / REST)
- Excellent communication skills and proven ability to explain technical concepts in a way that is understandable by all our internal customers.
- Be a strong team player. We work in small, tightly knit product teams that function cohesively to move as quickly as possible.
Nice to Have:
- Machine learning experience including relevant tools and packages.
Fivestars provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, or other applicable protected categories. In addition to federal law requirements, Fivestars complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
Tags: Airflow API Development APIs Athena AWS BigQuery Data pipelines Data Warehousing EC2 Engineering ETL GitHub GraphQL Jira Kafka Kinesis Lambda Machine Learning Pipelines PostgreSQL Python Redshift Snowflake SQL
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs