Senior Software Engineer - Real-time Data Infrastructure
San Jose, CA - Remote
Applications have closed
Sibros
Sibros' connected vehicle platform enables automakers with full lifecycle OTA software updates, data logging, remote diagnostics, and more.Sibros’ Fleet Intelligence is one of the core products that offers OTA (over-the-air) data collection to a fleet of vehicles and provides AI powered insights into fleet data analytics. This game changing product will bring automobile manufacturers the ability to access realtime data on millions scale fleets and take actions efficiently on advanced insights Sibros provides.
We are building a large-scale data real time system to handle billions of events per day coming from millions of vehicles and build data driven applications on top of that. Our platform has demanding requirements in latency, efficiency and scalability. As a part of the team, you will have hands-on experience to work on large scale distributed systems in real-time data infrastructure leveraging various open source technologies.
Your responsibilities include, but are not limited to:
- Team lead of real-time data infra, work with multiple parties to design platform roadmap, deliver milestones, etc.
- Design and implement scalable real-time data pipelines to process millions of vehicle events per second, and ingest terabytes of data into various storages.
- Use various open source tools and cloud solutions to automate infrastructure components and design the system to be cost effective.
- Build reliable and high performant systems including API, streaming, data lake to integrate and share data with customers.
- 4+ years of working experience in the software industry.
- Excellent understanding of computer science fundamentals, data structures, and algorithms.
- Strong track record in designing and implementing large scale distributed systems.
- Willingness to wear multiple hats and adapt to a fast-paced startup environment.
- Proficient in writing at least one programming language in production-grade.
- Passionate about the vision and mission of the company, and interested in solving challenging problems in the automotive IoT domain.
- Previous tech lead is a strong plus.
- Strong experience in writing Golang in production.
- Experience in operating data infrastructure.
- Experience in the public cloud and cloud-native technologies. E.g. AWS, GCP, Azure.
- Experience in working with large scale time-series databases such as Apache Druid, Pinot.
- Experience in working with streaming processing open source tools such as Apache Kafka, Flink.
- Experience in working with data warehouse technologies such as BigQuery, Databricks, Snowflake.
Sibros is committed to a policy of equal employment opportunity. We recruit, employ, train, compensate, and promote without regard to race, color, age, sex, ancestry, marital status, religion, national origin, disability, sexual orientation, veteran status, present or past history of mental disability, genetic information or any other classification protected by state or federal law.
Tags: APIs AWS Azure BigQuery Classification Computer Science Data Analytics Databricks Data pipelines Data warehouse Distributed Systems Flink GCP Golang Kafka Open Source Pipelines Snowflake Streaming
Perks/benefits: Startup environment Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Product Data Analyst jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs