Trustworthy Online Controlled Experiments

This book delves into the theoretical and practical foundations of causal inference, which is the core concept behind why A/B tests work. Readers who appreciate the rigorous, data-driven methodology of "Trustworthy Online Controlled Experiments" will find its analytical approach and practical examples highly valuable for deepening their understanding of experimentation.

Directly addressing the power and implementation of business experiments, this book offers a broader organizational perspective on why experimentation is crucial for innovation and decision-making, complementing the technical depth of Kohavi et al.'s work. It provides insights into building an experimentation culture and leveraging data for strategic advantage.

While not about A/B testing directly, this seminal work explores the cognitive biases that influence human decision-making. Understanding these biases is crucial for designing effective experiments, interpreting results without prejudice, and recognizing the value of empirical testing over intuition, making it a foundational read for data-driven practitioners.

This book explores how subtle interventions ("nudges") can influence choices, often informed by behavioral economics and validated through experimentation. Readers of "Trustworthy Online Controlled Experiments" will appreciate the practical application of data-driven insights to design better systems and guide user behavior ethically.

This book demystifies the role of randomness and probability in everyday life, which is fundamental to understanding statistical significance and the interpretation of experimental results. It offers an accessible yet rigorous exploration of concepts essential for anyone running or analyzing A/B tests.

This book leverages vast online data to uncover truths about human behavior, showcasing the power of digital data for insights. While more focused on observational studies than controlled experiments, it shares the same spirit of data-driven discovery and understanding user behavior through online traces.

Nate Silver's work focuses on the art and science of prediction, emphasizing the importance of statistical rigor, understanding uncertainty, and distinguishing meaningful signals from random noise. This critical thinking about data and evidence directly complements the principles of robust experimentation.

This book critically examines scientific claims and exposes flaws in research methodology, promoting a rigorous, evidence-based approach to understanding the world. Fans of Kohavi et al. will appreciate its emphasis on scientific integrity, valid experimental design, and critical evaluation of data, albeit in a broader scientific context.

For readers seeking a deeper dive into statistical methodology beyond frequentist A/B testing, this book offers a comprehensive introduction to Bayesian statistics. It provides a rigorous, principled framework for data analysis and inference, appealing to those who appreciate the mathematical and methodological depth of experimentation.

This book provides a practical guide for startups to use data and metrics to drive product development and business strategy, with a strong emphasis on experimentation and iterative learning. It offers a business-oriented perspective on applying data-driven principles, resonating with the practical application focus of "Trustworthy Online Controlled Experiments."