Senior Data Engineer - Austin (Remote)

Austin, Texas, United States

Applications have closed

About the Company

Craft is the leader in supplier intelligence, enabling enterprises to discover, evaluate and continuously monitor their suppliers at scale. Our unique, proprietary data platform tracks real-time signals on millions of companies globally, delivering best in class monitoring and insight into global supply chains. Our proprietary analytics layer delivers proactive alerts and multi-dimensional risk lenses showing supply chain problem areas before they have impact. Our software-as-a-service workflows enable supply chain professionals to execute the critical steps they need in supplier management digitally inside the intuitive, easy to use platform. Craft’s open supplier profiles appear in over 100 million organic search results each month, driving over 2 million monthly active users on Craft’s website: craft.co, with zero marketing spend. Our customers include Fortune 500 companies, government agencies, SMEs, global service platforms, and others.  We have distribution partnerships with some of the largest integrator and software platforms in the world.

We are a high-growth technology company, backed by top tier venture capital investors in Silicon Valley and Europe, including Greycroft, High Alpha, Uncork Capital, Sam Palmisano, Frederic Kerrest and others. The Craft team is headquartered in San Francisco with office hubs in Seattle and London. We fully support remote / hybrid, and have team members across the United States, Canada, and Europe. We are looking for innovative and driven people who are passionate about building the future of Enterprise Intelligence to join our rapidly growing team.

A note to candidates

We are an equal opportunity employer who values and encourages diversity, equity and belonging at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

About the role

Craft is looking for an experienced and motivated Senior Data Engineer to join the key team responsible for data ingestion and integration with data partners. Data is the foundation upon which everything is built. As a technical leader you will have a great say in how solutions are engineered and delivered, and will help mentor engineers on the team.

Craft gives engineers a lot of responsibility, which is matched by our investment in their growth and development. We are growing quickly, and the only limits to your future growth with Craft are your interests and abilities.

In this role you will be

  • Building and optimizing data pipelines (batch & streaming) for big data systems.

  • Extracting, Analyzing and Modeling of rich & diverse data sets.

  • Applying Data mining to techniques such as anomaly detection, clustering, regression, classification, summarization to extract value from our data sets.
  • Designing software that is easily testable and maintainable

  • Ensuring data analysis is in line with company policies and regulations.

  • Strong problem solving and the ability to communicate ideas effectively.

  • Provide expertise on the overall data engineering best practices, standards, architectural approaches and complex technical resolutions

  • Work on extendable data processing system that allows to add and scale pipelines with low-code approach

What we’re looking for

  • People that show curiosity through asking questions, digging into new technologies, and always trying to grow
  • 5+ years of experience in Data Engineering
  • 5+ years of experience with Python
  • Knowledge and experience of Amazon Web Services (AWS).
  • Experience using Terraform or other infrastructure-as-code tools.
  • Self-starter, independent, likes to take initiative.
  • Have fundamental and deep knowledge of data engineering techniques: ETL (Batch & Streaming), Data Warehouse, Data Lakes, MPP
  • Data analytical and statistical background would be a large plus

Our current technology stack

  • AWS Services: S3, Batch, Athena, Lambda, Kinesis, Kafka, Redshift, RDS / Aurora Postgres, DynamoDB
  • Data Pipelines: Python, SQL, Pandas, Dask, aws-data-wrangler, Papermill, Airflow, Prefect

What we offer

  • Competitive Salary + Equity at a well-funded, fast-growing startup
  • Unlimited Vacation time so you can take what you need, when you need it
  • Option to work 100% Remote or out of our San Francisco Office
  • 99% Covered Health + Dental + Vision insurance for employees and dependents
  • 401K through Human Interest with options to invest how you want it
  • $200 Monthly Wellness/Learning stipend (Gym memberships, meals, snacks, books, classes, conferences, etc.)
  • $1,000 Workstation Allowance (standing desk, chair, monitor, etc)

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: Airflow Athena AWS Big Data Classification Clustering Data analysis Data Mining Data pipelines Data warehouse DynamoDB Engineering ETL Kafka Kinesis Lambda MPP Pandas Pipelines PostgreSQL Python Redshift SQL Statistics Streaming Terraform

Perks/benefits: 401(k) matching Career development Competitive pay Conferences Equity Fitness / gym Flex vacation Health care Insurance Snacks / Drinks Startup environment Unlimited paid time off Wellness

Regions: Remote/Anywhere North America
Country: United States
Job stats:  4  0  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.