Staff Data Engineer
India
ABOUT LIVERAMP
LiveRamp is the leading data connectivity platform. We are committed to connecting the world’s data safely and effectively, advancing innovation, and empowering people to do good. Our platform powers customer experiences centered around the needs and concerns of real people, keeping the Internet open for all. We enable individuals around the world to connect with the brands and products they love. LiveRampers thrive on solving challenging problems for the good of humanity—and we’re always looking for smart, kind, and creative people to help us get there.
Mission: LiveRamp makes it safe and easy for businesses to use data effectively.
ABOUT THIS JOB
The Identity team at LiveRamp has a burning passion for building the best Identity Resolution capability in the world. Our platform ingests trillions of records of data, applies data science techniques to create massive, heterogeneous graphs, and then renders those graphs as the backend for extensible, reliable, high-performance APIs.
YOU WILL:
- Help your fellow engineers design and implement a scalable SaaS platform that is cloud agnostic.
- Gain experience working in multiple cloud environments such as GCP, AWS, Snowflake, and Azure.
- Build customizable, high-performance matching engines that can be deployed in regions all over the world to solve localized and client hosted data challenges.
- Implement customizable frameworks for graph access.
- Treat infrastructure as code leveraging tools like Docker, Kubernetes, Helm, and Terraform.
- Lead design for new product offerings in the Identity Resolution space.
- Design with privacy and security-first principles.
YOUR TEAM WILL:
- Build first of its kind Identity Resolution capabilities globally leveraging a variety of cloud technologies capable of meeting demanding high availability thresholds while serving a spectrum of low latency versus high throughput use cases.
- Enable configuration-driven workflows that automate batch and streaming-based processing on top of Identity Resolution services and assets.
- Provide an orchestration platform for complex graph builds using the latest open source and cloud native technologies.
ABOUT YOU:
- Have 7+ years of experience writing and deploying production code.
- Strong ability to break down complex problems to their essential components and design and implement elegant solutions for them.
- Experience with designing and implementing interfaces and infrastructure for large volume services and APIs.
- Curious to learn and comfortable evaluating and adapting to the latest tools and industry best practices.
- Good understanding of distributed computing, graph algorithms, distributed SQL
- Proficient in Scala, Java, and Python.
- Experience with data processing platforms such as Hadoop, Spark, Apache Beam, and Kafka. Proficient with programming using map-reduce paradigm.
- Proficient in cloud technologies
- Have a startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive.
BONUS POINTS:
- Experience with processing hundreds of terabytes or petabyte scale of data ● Strong mathematical background, knowledge of approximation algorithms and stream processing
- Familiarity with programming languages such as Kotlin or Go.
- Experience with Data Analytics Platform technologies like CDAP.
- Experience with designing and implementing interfaces and infrastructure for large volume services and APIs.
Tags: APIs AWS Azure Data Analytics Docker GCP Hadoop Helm Kafka Kubernetes Open Source Python Scala Security Snowflake Spark SQL Streaming Terraform
Perks/benefits: Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open GCP-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs