Senior Data Scientist, Experimentation
Reddit is an American social news aggregation, web content rating, and discussion website.
Reddit is a network of more than 100,000 communities where people can dive into anything through experiences built around their interests, hobbies and passions. Reddit users submit, vote and comment on content, stories and discussions about the topics they care about the most. From pets to parenting, there’s a community for everybody on Reddit and with more than 50 million daily active people, it is home to the most open and authentic conversations on the internet. For more information, visit redditinc.com.
Reddit is continuing to grow our teams with the best talent. We're completely remote friendly and will continue to be after the pandemic. Learn more about how we're evolving Reddit's workforce here.
We are looking for a Senior Data Scientist to lead our Data Science efforts on Experimentation and to partner with our Engineering team to drive and implement the vision of Experimentation at Reddit.
Our Experimentation Platform has been used by our Product and Engineering teams to run thousands of experiments in order to ensure that we fully understand our users and create the best possible experiences, as well as to roll out thousands of features in a safe and trustworthy way. In 2021, we rapidly scaled our Experimentation team and are quickly turning the platform into a world-class framework, capable of even greater scale and effectiveness.
As a Senior Data Scientist for Experimentation you will join a small but growing team and will be pivotal in driving company-wide innovation and rigor, shaping our metrics strategy, and building a strong experimentation culture. The opportunity for impact will be great as you enhance the success and understanding of our products across our diverse and growing user base.
How You’ll Have Impact:
Reddit’s mission is to bring community and belonging to everyone in the world, and you will be pivotal in making that happen. As the 6th largest site on the internet Reddit has a dramatic scale but at 1000+ employees you won’t be stuck making small incremental gains on enterprise systems. You will create organization-wide capabilities to run more advanced experiments and create publication quality research, leverage complex testing and optimization algorithms to grow revenue, and produce more robust results faster to help teams increase their velocity and effectiveness.
What You’ll Learn:
You will partner closely with a world-class org of Engineering, ML, Search, Data Science, Data Engineering, and Analytics practitioners who work together to create a variety of capabilities for Reddit to be more successful in its decision-making and product creation. In particular, you’ll be exposed to and drive adoption of a variety of new techniques in modeling, experimentation, statistical frameworks, and causal inference.
What You’ll Do:
- Be the main point of contact for Data Science / statistics of experimentation, creating and implementing the roadmap for the stats engine of Reddit’s Experimentation Platform, providing guidance on experiment design, execution, analysis, and metrics across the entire company.
- Apply modeling (advanced statistical methods, machine learning) to improve the accuracy of our experimental results (e.g. variance reduction techniques such as CUPED).
- Be responsible for platform-wide Data Science process & analyses, defining company-wide experiment processes (delegation of authority when certain metrics are impacted, etc.), communicating good experimentation best practices and setting the standard for experiment design for the entire organization.
- Ensure high-quality and trustworthy experiment results and ensure that experimental designs lead to action.
- Collaborate with multiple engineers/product teams across the whole company to find technical solutions to complex experiment design challenges.
- Develop and adopt statistical methods that help Reddit teams better measure their feature areas, as well as the toolset to help experimenters understand the “why” behind what they are seeing in their experiments.
- Perform meta-analysis on experiments to understand macro trends in our product ecosystem and to understand the health of experiments for the company as a whole.
Who You Might Be:
- 5+ years of experience in quantitative or data science roles, preferably for a consumer-facing service/app
- 2+ years of experience focused on experiment design and/or A/B testing at scale
- Able to demonstrate application of the statistical underpinnings of experimentation: hypothesis testing, p-values, causal inference, etc.
- Familiar with statistical analysis and programming languages (e.g., R / Python)
- Proficient with querying relational databases (e.g., SQL)
- Results-oriented with a strong customer and business focus
- Entrepreneurial and self-directed, demonstrated ability to innovate and bias toward action in fast-paced environments
- Able to communicate and discuss complex topics with technical and non-technical audiences
- Able to tackle ambiguous and undefined problems
Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at [email protected].
Founded by Steve Huffman and Alexis Ohanian in 2005, Reddit is an online community where users submit, vote, and comment on content, news, and discussions. Nicknamed "the front page of the internet," Reddit is one of the top ten sites in the United States (source: Alexa), with hundreds of millions of users each month on desktop, mobile web, and our official Android/iOS apps.
Want to learn more about Reddit? Visit Reddit's website.
Software that predicts technology trends.