Why we use experiment quality as the main KPI for our experimentation platform
https://medium.com/booking-product/why-we-use-experimentation-quality-as-the-main-kpi-for-our-experimentation-platform-f4c1ce381b81 The most important aspect of product success is that it solves its core customer problem. In our case, this core problem is making reliable evidence-based product decisions using experimentation, both on the tactical and strategic level. What really matters to us is not how many product decisions are made,...
The effects of remote work on collaboration among information workers
https://www.nature.com/articles/s41562-021-01196-4 The coronavirus disease 2019 (COVID-19) pandemic caused a rapid shift to full-time remote work for many information workers. Viewing this shift as a natural experiment in which some workers were already working remotely before the pandemic enables us to separate the effects of firm-wide remote work from other pandemic-related...
Task complexity moderates group synergy
https://www.pnas.org/content/118/36/e2101062118 Scientists and managers alike have been preoccupied with the question of whether and, if so, under what conditions groups of interacting problem solvers outperform autonomous individuals. Here we describe an experiment in which individuals and groups were evaluated on a series of tasks of varying complexity. We find that...
Investor memory of past performance is positively biased and predicts overconfidence
https://www.pnas.org/content/118/36/e2026680118 This paper makes several contributions to research in memory, overconfidence, and investment behavior. First, we find that investors’ memories for past performance are positively biased. They tend to recall returns as better than achieved and are more likely to recall winners than losers. No published paper has shown these...
Collaboration Overload Is Sinking Productivity
https://hbr.org/2021/09/collaboration-overload-is-sinking-productivity Cognitive psychologists have shown that the act of simply responding to a text can impose as much as a 64-second recovery time to get back on track. As Gloria Mark, professor of informatics at the University of California, Irvine, has shown in her research, it can take us as...
Large-scale randomized experiments reveals that machine learning-based instruction helps people memorize more effectively
https://www.nature.com/articles/s41539-021-00105-8, Data and code We perform a large-scale randomized controlled trial involving ~50,700 learners of at least 18 years of age in Germany who use an app to study for the written portion of the driver’s permit from December 2019 to July 2020 and gave consent to participate in the...
Posthog handbook compensation
https://posthog.com/handbook/people/compensation You can use our calculator below to work out what your salary would be for a few example roles. We think the fastest possible shipping comes from a leaner, stronger team, so we try to pay top of market. We pay well, so you’ll work with the best people...
A Theoretical Assessment Ecosystem for a Digital-First Assessment—The Duolingo English Test
https://duolingo-papers.s3.amazonaws.com/other/det-assessment-ecosystem.pdf The Duolingo English Test is a groundbreaking, digital-first, computer-adaptive English language proficiency test. In contrast to traditional assessments, the Duolingo English Test is a digital-first assessment, leveraging “human-in-the-loop AI” from end to end to automatically generate test items and score test-taker item responses. This paper presents a novel theoretical...
PostHog strategy overview
https://posthog.com/handbook/strategy/strategy Mission Increase the number of successful products in the world Long Term Vision (for 2023) Everyone building a product has a clear path to making it successful without losing control of their data This means engineers can install PostHog and within a few hours, qualitative and quantitative data will...
What is product management analytics?
https://mixpanel.com/blog/what-is-product-management-analytics/ Goals, KPIs and metrics Though often used interchangeably, goals, key performance indicators (KPIs), and metrics are not the same. Rather, they sit in a hierarchy, with goals on top. Goals are a company’s highest level priority, such as driving revenue; KPIs measure progress toward goals; and metrics measure progress...
About
a collection of excerpts from interesting research, blogs, events, etc...