Senior/Staff Software Engineer, AI Infrastructure
Shibuya, Tokyo, Japan
SmartNews
SmartNews strives to deliver quality information for our users through advanced algorithms and simple user interfaces.About SmartNews
SmartNews is a global leader in redefining information and news discovery, committed to providing users with accurate, timely information and supporting quality journalism. We combine the power of our unique machine-learning technology with the expertise of our first-rate editorial team to bring news that matters to millions of users from our over 3,000 global publishing partners.
Founded in 2012 in Tokyo, Japan, SmartNews has offices in Tokyo, San Francisco, Palo Alto, New York, and Singapore.
The Team
Our AI Infrastructure team is responsible for building cutting-edge infrastructure and toolings for feature engineering, distributed training, AutoML, inference services, and LLM infrastructure that can satisfy real-time requirements and scale to billions of users.
In this role, you will:
- Be responsible for setting the technical directions of critical areas of the AI Infrastructure Team by working closely with Ranking, Content Understanding and other machine learning teams of the company
- Lead design and implementation of core systems of AI platforms that support feature engineering platforms, distributed training, and highly scalable inference services;
- Work across the team and effectively resolve collaboration issues with dependency and client teams to deliver AI Infrastructure projects successfully
- Solve the hardest problems of the team
Requirements
Required Experience
- 5+ years of experience in architecting, developing, and shipping software products with large-scale
- 2+ years of experience in the fields of AI infrastructure/platform
- Expert coding abilities in multiple programming languages (e.g., Java, C++, Python, Scala)
- Experience with Hive, Airflow, Scylla, Redis, Elasticsearch
- Experience in development related to Spark, Hadoop, Flink, ClickHouse, Presto/Trino
- Experience with data processing related to an app or website.
- Able to distill complex problems and drive toward creative solutions. Able to have a deep end-to-end understanding of sophisticated distributed systems and can proactively detect problems and make/implement improvement suggestions
- Able to demonstrate strong leadership and set an example at the team level for engineering excellence
- Able to thrive in a dynamic environment where goals and requirements may be changing
- Solid understanding of how state-of-the-art machine learning algorithms work on a large scale and proven track record of building supporting infrastructure
- Good written and spoken communication skills can work across functional teams
- MS or BS in computer science, mathematics, physics, or other quantitative fields
Nice to have
- Experience developing ranking/recommendation/search-related systems
- Failure analysis and performance tuning in JVM operation
Benefits
Perks and Benefits at the SmartNews Tokyo Office
- Lunch and snacks prepared daily in our on-site kitchen facility
- In-office coffee stand offering single-origin coffees, espresso-based beverages, teas, and other seasonal drinks
- SmartSelect, our support program for employee self-development, well-being, and productivity
- All healthcare and social insurance required by the Japanese labor law
Visa Sponsorship and Relocation Support
- Work visa sponsorship is available for candidates who meet eligibility requirements
- To support a smooth transition for candidates who are moving to Japan from overseas, SmartNews partners with a travel service provider
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Computer Science Distributed Systems Elasticsearch Engineering Feature engineering Flink Hadoop Java LLMs Machine Learning Mathematics ML infrastructure Physics Python Scala Spark
Perks/benefits: Career development Relocation support Snacks / Drinks
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Research Scientist jobs
- Open Data Science Manager jobs
- Open Junior Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Scientist II jobs
- Open Principal Data Scientist jobs
- Open BI Analyst jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Engineer jobs
- Open Data Science Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Business Intelligence Analyst jobs
- Open Lead Data Analyst jobs
- Open Software Engineer, Machine Learning jobs
- Open Azure Data Engineer jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Engineer III jobs
- Open Data Analytics Engineer jobs
- Open Marketing Data Analyst jobs
- Open Junior Data Engineer jobs
- Open Data Engineering Manager jobs
- Open Product Data Analyst jobs
- Open Data Analyst II jobs
- Open Privacy-related jobs
- Open GCP-related jobs
- Open Tableau-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open LLMs-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open Consulting-related jobs
- Open Business Intelligence-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Data governance-related jobs
- Open NLP-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Docker-related jobs
- Open Git-related jobs
- Open Hadoop-related jobs