Sr. Software Engineer, Data Infrastructure Streaming Platform

Bellevue, WA, San Francisco, CA

Applications have closed

Flexport

Cut costs, automate workflows, reliably move goods, go carbon-neutral, and improve your supply chain from end to end. It all starts here.

View company page

The opportunity

The Data Infrastructure team at Flexport is rapidly growing, and we want to add an experienced engineer to help build our data infrastructure. Our data infrastructure includes streaming, messaging, search, data API layer, data orchestration, data integrations, and transactional databases. We are ready to push the limits with our next-generation data infrastructure. You will lead the data architecture and best practices to provide the best experience to the data community at Flexport.

The Streaming and Messaging team within Data Infrastructure is responsible for building high-level platforms to ingest, process, and consume raw data produced by source systems at Flexport in near real-time. We support event-driven architectures, provide message brokers, and enable stream processing for services and applications. With these infrastructure setups, Flexport can adapt and utilize data infrastructure efficiently across a wide variety of teams, allowing them to make data-driven decisions in a timely fashion. Our team sits between Product Engineering Teams and the Data Engineering Teams, enables wide adoption, and sets standards for data ingestion and stream processing across Flexport. Our solutions are generic enough to be used by any company with similar security, stability, scalability, and cost requirements.

You will:

  • Design the data streaming and messaging architecture, and own the data landscape, including near real-time data ingestion, processing, and data consumption.
  • Build infrastructure to support various workloads (Kafka, Kafka connect, Snowpipe, data ingestion, Snowflake Query / API layer)
  • Work closely with data stakeholders to distill complex data problems into elegant technical solutions by providing core abstractions to ingest and process data at scale.
  • Work across teams to onboard stakeholders to the platform, and identify and solve pain points in our data architecture.
  • Document processes, run books, and onboarding guides to the data stakeholders.
  • Design and develop disaster recovery plans to ensure data integrity.
  • You play a significant role in the career development of others, actively mentoring and educating the data community on trends, technologies, and best practices.

You should have the following:

  • Bachelor's degree in Computer Science or equivalent practical experience
  • 5+ years of hands-on experience building and operating critical data infrastructure on streaming and messaging platforms.
  • Demonstrable knowledge of streaming and messaging architectures.
  • Experience with Kafka and the AWS ecosystem is preferred.
  • Experience designing, building, and deploying scalable cloud-based architectures.
  • Experience in designing end-to-end data flows for both transactional and analytics use cases.
  • Experience with data governance and security practices.
  • Demonstrable skills in at least one programming language - Ruby, Python, or Java.

#LI-RP2

About Flexport:

At Flexport, we believe global trade can move the human race forward. That’s why it’s our mission to make it easy and accessible for everyone. We’re shaping the future of an $8.6T industry with solutions powered by innovative technology and exceptional people. Today, companies of all sizes—from emerging brands to Fortune 500s—use Flexport technology to move more than $19B of merchandise across 112 countries a year. 

The recent global supply chain crisis has put Flexport center stage as we continue to play a pivotal role in how goods move around the world. At a valuation of $8 billion, we’re experiencing record growth and are proud to have the support of the best investors in the game who believe in our mission, solutions, and people. Ready to tackle global challenges that impact business, society, and the environment? Come join us.

The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Our salary ranges are determined by role, level, and location. Within the range displayed, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education and / or training. The US base salary range for this full-time position: (exclusive of bonus, equity and benefits.)$246,094—$270,703 USD

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: APIs Architecture AWS Computer Science Data governance Engineering Java Kafka Python Ruby Security Snowflake Streaming

Perks/benefits: Career development Equity Salary bonus Startup environment

Region: North America
Country: United States
Job stats:  2  1  0
Category: Engineering Jobs

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.