Data Science Manager, Experimentation
San Francisco, New York City, Remote
“The front page of the internet," Reddit brings millions and millions of people together each month through their common interests, inviting them to share, vote, comment, and create across thousands of communities.
We are looking for a Data Science Manager to lead our Data Science horizontal on Experimentation and to partner with our Engineering team to drive and implement the vision of Experimentation at Reddit.
Our Experimentation Platform has been used by our Product and Engineering teams to run thousands of experiments in order to ensure that we fully understand our users and create the best possible experiences, as well as to roll out thousands of features in a safe, appropriate way. In 2021, we have rapidly scaled our Experimentation team and are quickly turning the platform into a world-class framework, capable of even greater scale and effectiveness.
As the Data Science Manager for Experimentation you will lead a small but growing team and will be pivotal in driving company-wide innovation and rigor, shaping our metrics strategy, and building a strong experimentation culture. The opportunity for impact will be great as you enhance the success and understanding of our products across our diverse and growing user base.
How You’ll Have Impact:
Reddit’s mission is to bring community and belonging to everyone in the world, and you will be pivotal in making that happen. As the 6th largest site on the internet Reddit has a dramatic scale but at 1000+ employees you won’t be stuck making small incremental gains on enterprise systems. You will create organization-wide capabilities to run more advanced experiments and create publication quality research, leverage complex testing and optimization algorithms to grow revenue, and produce more robust results faster to help teams increase their velocity and effectiveness.
What You’ll Learn:
You will partner closely with a world-class org of Engineering, ML, Search, Data Science, Data Engineering, and Analytics practitioners who work together to create a variety of capabilities for Reddit to be more successful in its decision-making and product creation. In particular, you’ll be exposed to and drive adoption of a variety of new techniques in modeling, experimentation, statistical frameworks, and causal inference.
What You’ll Do:
- Be the main point of contact for Data Science / statistics of experimentation, creating and implementing the roadmap for the stats engine of Reddit’s Experimentation Platform, providing guidance on experiment design, analysis, and metrics
- Apply modeling (advanced statistical methods, machine learning) to improve the accuracy of our experimental results (e.g. variance reduction techniques such as CUPED)
- Be responsible for platform-wide Data Science process & analyses, defining company-wide experiment processes (delegation of authority when certain metrics are impacted, etc.), communicating good experimentation best practices and setting the standard for experiment design for the entire organization
- Ensure high-quality and trustworthy experiment results and ensure that experimental designs lead to action
- Collaborate with multiple engineers/product teams across the whole company to find technical solutions to complex experiment design challenges
- Develop and adopt statistical methods that help Reddit teams better measure their feature areas
- Perform meta-analysis on experiments to understand macro trends in our product ecosystem and to understand the health of experiments for the company as a whole
Who You Might Be:
- 5+ years of experience in quantitative or data science roles, preferably for a consumer-facing service/app
- 1+ years of experience focused on experiment design and/or A/B testing
- Demonstrated application of the statistical underpinnings of experimentation: hypothesis testing, p-values, causal inference, etc.
- Familiarity with statistical analysis and programming languages (e.g., R / Python)
- Proficiency with querying relational databases (e.g., SQL)
- Results-oriented with a strong customer and business focus
- Entrepreneurial and self-directed, demonstrated ability to innovate and bias toward action in fast-paced environments
- Ability to communicate and discuss complex topics with technical and non-technical audiences
- Ability to tackle ambiguous and undefined problems
Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at ApplicationAssistance@Reddit.com.
Tags: A/B testing Causal inference Engineering Machine Learning Python R RDBMS Research SQL Statistics Testing
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs