Sr. Software Engineer, Data Infrastructure Streaming Platform
Bellevue, WA, San Francisco, CA
Flexport
Cut costs, automate workflows, reliably move goods, go carbon-neutral, and improve your supply chain from end to end. It all starts here.The opportunity
The Data Infrastructure team at Flexport is rapidly growing, and we want to add an experienced engineer to help build our data infrastructure. Our data infrastructure includes streaming, messaging, search, data API layer, data orchestration, data integrations, and transactional databases. We are ready to push the limits with our next-generation data infrastructure. You will lead the data architecture and best practices to provide the best experience to the data community at Flexport.
The Streaming and Messaging team within Data Infrastructure is responsible for building high-level platforms to ingest, process, and consume raw data produced by source systems at Flexport in near real-time. We support event-driven architectures, provide message brokers, and enable stream processing for services and applications. With these infrastructure setups, Flexport can adapt and utilize data infrastructure efficiently across a wide variety of teams, allowing them to make data-driven decisions in a timely fashion. Our team sits between Product Engineering Teams and the Data Engineering Teams, enables wide adoption, and sets standards for data ingestion and stream processing across Flexport. Our solutions are generic enough to be used by any company with similar security, stability, scalability, and cost requirements.
You will:
- Design the data streaming and messaging architecture, and own the data landscape, including near real-time data ingestion, processing, and data consumption.
- Build infrastructure to support various workloads (Kafka, Kafka connect, Snowpipe, data ingestion, Snowflake Query / API layer)
- Work closely with data stakeholders to distill complex data problems into elegant technical solutions by providing core abstractions to ingest and process data at scale.
- Work across teams to onboard stakeholders to the platform, and identify and solve pain points in our data architecture.
- Document processes, run books, and onboarding guides to the data stakeholders.
- Design and develop disaster recovery plans to ensure data integrity.
- You play a significant role in the career development of others, actively mentoring and educating the data community on trends, technologies, and best practices.
You should have the following:
- Bachelor's degree in Computer Science or equivalent practical experience
- 5+ years of hands-on experience building and operating critical data infrastructure on streaming and messaging platforms.
- Demonstrable knowledge of streaming and messaging architectures.
- Experience with Kafka and the AWS ecosystem is preferred.
- Experience designing, building, and deploying scalable cloud-based architectures.
- Experience in designing end-to-end data flows for both transactional and analytics use cases.
- Experience with data governance and security practices.
- Demonstrable skills in at least one programming language - Ruby, Python, or Java.
#LI-RP2
About Flexport:
At Flexport, we believe global trade can move the human race forward. That’s why it’s our mission to make it easy and accessible for everyone. We’re shaping the future of an $8.6T industry with solutions powered by innovative technology and exceptional people. Today, companies of all sizes—from emerging brands to Fortune 500s—use Flexport technology to move more than $19B of merchandise across 112 countries a year.
The recent global supply chain crisis has put Flexport center stage as we continue to play a pivotal role in how goods move around the world. At a valuation of $8 billion, we’re experiencing record growth and are proud to have the support of the best investors in the game who believe in our mission, solutions, and people. Ready to tackle global challenges that impact business, society, and the environment? Come join us.
The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Our salary ranges are determined by role, level, and location. Within the range displayed, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education and / or training. The US base salary range for this full-time position: (exclusive of bonus, equity and benefits.)$246,094—$270,703 USD* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Architecture AWS Computer Science Data governance Engineering Java Kafka Python Ruby Security Snowflake Streaming
Perks/benefits: Career development Equity Salary bonus Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data warehouse-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs