Prompt and Applicable Context
A consumer productivity app began May with 120,000 paid monthly-renewing subscriptions. By the reporting cutoff, 7,200 of that starting population had fully expired and had not resubscribed. On that definition, monthly gross subscriber churn is 7,200 / 120,000 = 6.0%, compared with a mature 4.0% baseline. Acquisition remained stable. Diagnose the increase, prioritize what to change, and design a decision process for scaling, iterating, or stopping each intervention.
This is a fictional product execution case for product managers, growth PMs, subscription PMs, and monetization PMs. All users, counts, rates, periods, causes, and experiment results are replaceable practice assumptions. Current PM interview materials explicitly include designing a feature to reduce subscription churn and asking how to reduce churn in a subscription app. That supports the prompt's current relevance, but it does not establish interview frequency or attribute it to a named company.
The first calculation suggests 120,000 × (6.0% - 4.0%) = 2,400 excess losses. That comparison is valid only if the metric, cutoff, population at risk, subscription duration, and cohort maturity are comparable. A cancellation event can mean auto-renewal was turned off while access continues; an expiration means access ended. A failed renewal can enter a retry or grace period and later recover. Mixing those states can manufacture a churn spike or make a real one look smaller.
What the Interviewer Evaluates
The first signal is measurement discipline. A strong candidate defines gross subscriber churn with a fixed beginning-of-period denominator and says whether “lost” means cancellation intent, failed renewal, entitlement expiration, or expiration net of resubscription. Customer churn and gross revenue churn also answer different questions when plans, discounts, seats, or downgrades vary.
The second signal is diagnosis before solution. “Send a discount” skips instrumentation errors, billing failures, weak first-cycle value, reliability regressions, price changes, acquisition-mix shifts, and seasonal renewal exposure. A useful diagnosis estimates how much each cause contributed to the change, not merely how common each reason is among churned subscribers.
The third signal is causal prioritization. Cancellation surveys and support interviews explain mechanisms but are selected and self-reported. Product usage predicts risk but does not prove that forcing more usage will retain people. A strong answer combines lifecycle data, behavior, qualitative evidence, and controlled interventions, then states what each source cannot prove.
The fourth signal is matching the intervention to the failure mode. Payment recovery addresses an expired card or temporary decline; it cannot repair missing product value. Better activation can help an early-tenure subscriber who never completes the core job; it cannot resolve a price increase for a mature user. A broad incentive may save some accounts while discounting people who would have renewed anyway.
The final signal is business judgment. The goal is not the lowest possible churn at any cost. The decision metric should capture incremental paid retention or contribution over an appropriate renewal horizon, while refunds, chargebacks, complaints, support load, unpaid access, and trust remain within precommitted boundaries.
Questions to Clarify Before Answering
- What event and cutoff define churn? Count fully expired paid subscriptions using a stated resubscription window. Keep cancellation intent, billing issue, grace period, expiration, recovery, refund, and reactivation as separate events. A product may track each as a leading signal without calling all of them churn.
- Who had an opportunity to renew? Monthly and annual plans, trials, pauses, extensions, and subscriptions that started mid-period do not share the same exposure. Compare cohorts only after they reach the same renewal opportunity.
- Is the baseline comparable? Recompute the prior 4.0% under the current definition, timezone, late-event policy, product mix, geography, channel, price, platform, and tenure. Also inspect several mature periods rather than choosing a convenient month.
- Are we optimizing subscribers or revenue? Subscriber churn gives each lost subscription equal weight. Gross revenue churn weights lost recurring revenue and includes contraction. The primary metric should follow the business problem, with the other retained as a guardrail or diagnostic.
- Where did the change occur? Break down renewal exposure and loss rate by billing-failure status, tenure or renewal number, plan, price, platform, geography, acquisition cohort, core-value completion, recent reliability exposure, and cancellation reason. Use stable predeclared segments before exploring smaller slices.
- What changed before the increase? Audit releases, pricing, payment routing, retry settings, notification delivery, acquisition mix, outages, performance, policy, seasonality, and competitor events. The timing must precede the affected renewal opportunity to be a plausible cause.
- What constraints apply to interventions? Confirm discount authority, communications consent, accessibility, refund policy, payment-processor rules, grace-period economics, engineering capacity, and the maximum acceptable delay before a decision.
30-Second Answer Framework
“I would first lock the metric: paid subscriptions from the starting population that fully expired during May and did not resubscribe by the agreed cutoff, divided by paid active subscriptions at the start of May. I would reconcile lifecycle events and recompute the 4% baseline on the same basis. If the two-point increase remains, it represents about 2,400 excess losses. I would decompose that excess by prior segment-specific rates on the current exposed population, then combine billing state, renewal number, product-value events, reliability, price, and customer evidence to rank causes. Each cause gets a different intervention and controlled test. I would scale only when the test improves paid retention or retained contribution after the next renewal, without breaching refund, complaint, chargeback, support, or trust guardrails.”
Step-by-Step Deep Dive
Step 1: Build a subscription state ledger before analyzing causes
Create one auditable record per subscription and renewal opportunity: plan, price, acquisition cohort, start and scheduled renewal times, auto-renew status, invoice attempts, grace or retry state, entitlement end, recovery, refund, resubscription, and the final classification at the reporting cutoff. Reconcile counts with the billing processor and entitlement system. Late webhooks, duplicate customer identities, timezone boundaries, backfilled refunds, and test accounts should have explicit handling.
Use two related views:
Gross subscriber churn
= subscriptions from the starting population that expired in the period and remain lost at cutoff
/ paid active subscriptions at the beginning of the period
Renewal retention for cohort k
= successful paid renewals at opportunity k
/ subscriptions that reached renewal opportunity kThe first is a period health metric. The second reveals whether the first, second, or later renewal deteriorated and avoids comparing immature cohorts with mature ones. Report gross revenue churn separately when price or plan value varies. Do not subtract new subscribers or expansion from gross churn; those belong in net growth measures.
Step 2: Verify the spike before explaining it
Recalculate May and the baseline from raw lifecycle events using one versioned metric contract. Check numerator and denominator changes independently. If churned subscriptions rose because twice as many annual plans happened to renew, the rate may be stable after exposure adjustment. If the denominator excludes subscribers in grace while the numerator later counts their expiration, the metric can be internally inconsistent.
Compare cohort maturity and confidence intervals, but do not treat statistical significance as data validity. Slice first by known operational boundaries: store or billing processor, product version, renewal number, plan, country, acquisition channel, and exposure to incidents. A sudden concentration on one processor or release points to an operational path; broad movement across mature cohorts supports a wider value or pricing problem.
Step 3: Attribute the excess, not just the total
For every stable segment, calculate expected losses by applying its prior rate to its current exposed population. The contribution is current losses minus expected losses. The contributions should reconcile to the approximately 2,400 excess losses, with an interaction or residual bucket when segment dimensions overlap.
Expected losses in segment s
= current renewal-eligible subscriptions in s × prior comparable churn rate in s
Excess contribution from segment s
= current losses in s - expected losses in sA fictional decomposition might attribute 1,200 excess losses to final billing-failure expirations, 700 to first- and second-renewal subscribers who never completed the core workflow, 300 to a price-sensitive segment, and 200 to residual causes. These values sum to 2,400; they are an illustration, not evidence. Use a mutually exclusive first pass, then investigate interactions such as a price change affecting one channel disproportionately.
Overlay qualitative evidence after quantification. Sample churned, retained, recovered, and downgrade-seeking subscribers from the same segments. Cancellation reasons reveal stated motives; session and support evidence tests whether the product behavior agrees. “Too expensive” may mean genuine affordability, weak realized value, or a confusing charge. The remedy changes with that interpretation.
Step 4: Match interventions to mechanisms and reversibility
Prioritize with expected recoverable contribution, confidence in the cause, time to evidence, implementation cost, and downside risk. In the fictional decomposition, payment failure represents half the excess and can often be tested with payment-update prompts, processor-supported retry timing, and an explicitly bounded grace policy. Measure recovered paid renewals, not messages sent. Track duplicate contacts, chargebacks, complaints, support volume, and unpaid entitlement days.
For early-tenure value failure, target subscribers who have not completed the smallest behavior credibly linked to the product's job. Test a shorter setup path, contextual guidance, or a workflow fix. The leading metric can be core-value completion, but the decision metric must mature through the next paid renewal. If a reliability regression caused loss, repair and verify the incident path before testing engagement tactics.
For price-related loss, compare clearer value communication, pause, downgrade, or a targeted save offer. A control group is essential because some people who enter a cancellation flow would renew without an incentive. A lower cancellation-button click rate is not retained value; it may only add friction.
Step 5: Design tests around the renewal decision
Randomize at the subscriber or household level when members can influence one another, and assign before the intervention. Define eligibility, exposure, exclusions, the minimum practical effect, horizon, and analysis plan in advance. Keep a holdout where policy and customer fairness allow. For a payment-failure test, stratify by decline class and renewal cycle; for an onboarding intervention, randomize before the target workflow can occur.
Use a metric ladder:
| Layer | Examples | Decision role |
|---|---|---|
| Mechanism | Payment method updated, core workflow completed, pause selected | Confirms the intervention acted on the intended cause |
| Primary outcome | Incremental paid retention through the next comparable renewal | Decides whether churn actually improved |
| Economic outcome | Incremental retained contribution over a fixed horizon | Prevents discounts and free access from masquerading as success |
| Guardrails | Refunds, chargebacks, complaints, support load, message opt-out, reliability | Limits customer and operating harm |
Observe every included subscriber until the relevant renewal opportunity or mark the outcome as immature. Avoid early peeking based only on cancellation reversals. Analyze intent to treat first; exposure-based analysis can diagnose delivery failures but should not replace the randomized comparison.
Step 6: Convert retention into incremental contribution
For each intervention, compare treatment and control over the same horizon:
Incremental retained contribution
= additional paid renewals × expected contribution during the evaluation horizon
- discounts, credits, payment and communication costs
- refunds, chargebacks, support, and incremental service costs
- contribution lost from subscribers who would have renewed at full priceUse observed subsequent renewal when it matures rather than assuming every recovered subscriber has the same lifetime. Report uncertainty and sensitivity to contribution horizon. A cheap payment recovery can scale with modest lift; a permanent discount requires stronger evidence because its cost repeats and can alter future willingness to pay.
Step 7: Precommit scale, iterate, and stop rules
Scale a mechanism only if the primary effect exceeds the minimum practical threshold, the economic interval supports positive incremental contribution, guardrails pass, and the operational path is reliable. Iterate when the mechanism moved but paid retention did not, or when one identifiable segment benefits while another does not. Stop when the causal premise fails, the interval rules out worthwhile impact, harm crosses a boundary, or the program relies on hidden friction.
Maintain a persistent untreated holdout or rotate controlled tests when feasible to detect novelty and policy drift. Continue reporting the original 6.0% metric with its fixed definition; changing the definition after an intervention can create an artificial win.
High-Quality Sample Answer
“I would not start with a discount campaign. First I would define the observed 6.0% as 7,200 fully expired paid subscriptions from the starting population that had not resubscribed by the reporting cutoff, divided by 120,000 paid active subscriptions at the start of May. I would keep auto-renew cancellation, failed payment, grace period, expiration, recovery, refund, and resubscription as separate lifecycle events and recompute the mature 4.0% baseline under that same contract.
If the increase survives reconciliation, it represents roughly 2,400 excess losses. I would estimate expected losses from prior segment-specific rates on the current renewal-eligible population and reconcile the contributions. My first cuts would be billing state, renewal number and tenure, plan and price, platform, country, acquisition cohort, core-workflow completion, and exposure to outages or releases. Then I would interview matched samples of expired, retained, and recovered subscribers. Survey reasons explain language and motivation, while lifecycle and usage data establish when and where the loss happened.
Suppose the fictional analysis attributes 1,200 excess losses to final billing-failure expirations, 700 to first- and second-renewal subscribers who never completed the core workflow, 300 to a price-sensitive segment, and 200 to residual causes. I would address billing first because it explains half the excess, has a specific mechanism, and can be tested reversibly. I would compare processor-supported retry and payment-update treatment with an eligible holdout, stratified by failure type. The primary outcome is incremental paid retention through a fixed renewal horizon, with chargebacks, duplicate contacts, complaints, support load, and unpaid-access days as guardrails.
In parallel, I would randomize a shorter path to the core workflow for eligible early-tenure subscribers. Workflow completion is a mechanism metric; renewal at the next opportunity is the decision metric. For price-related loss, I would test pause, downgrade, or a targeted offer against control and calculate incremental contribution. I would not count clicks on ‘stay subscribed,’ because some of those users would have renewed anyway and discounts can buy a misleading save rate.
I would scale each intervention independently only when its paid-retention lift is practically meaningful, retained contribution remains positive after incentives and service costs, and guardrails pass. If payment updates rise but paid retention does not, I would investigate the recovery state or stop. If activation improves only for one acquisition cohort, I would target that cohort rather than ship broadly. If the original 6.0% disappears after fixing event timing, I would repair measurement and withdraw the churn claim instead of launching a retention program.”
Common Mistakes
- Treating cancellation as immediate churn → Subscribers may retain access and reverse cancellation before expiration → Track intent separately and count churn under a fixed expiration and resubscription rule.
- Comparing all subscribers with all subscribers → Different plan durations and cohort ages create unequal renewal opportunity → Compare cohorts at the same renewal number and maturity.
- Ranking causes by raw churned-user count → A large segment can have many losses without causing the increase → Apply prior segment rates to current exposure and attribute excess losses.
- Using a churn prediction score as a cause → Correlated behavior identifies risk but does not show what intervention will work → Form a mechanism hypothesis and test a targeted action.
- Sending discounts to everyone who clicks cancel → Some would renew at full price, so saves can destroy contribution → Use a control and measure incremental retained contribution.
- Optimizing cancellation-flow completion → Added friction can suppress clicks while increasing frustration and later refunds → Measure paid retention after the renewal opportunity with trust guardrails.
- Declaring victory from an early leading metric → Payment updates or workflow completion may not produce another paid renewal → Wait for the precommitted outcome horizon and label immature cohorts.
- Changing the churn definition after launch → The intervention appears to work because the accounting moved → Version the metric contract and backfill every comparison consistently.
Follow-Up Questions and Responses
Follow-up 1: Churn rose only among subscribers acquired from one paid channel. Would you change the product?
First verify campaign, offer, geography, device, and cohort maturity within that channel. Compare the promised job, activation, renewal exposure, and contribution with other cohorts. If the channel attracts low-fit users despite accurate product delivery, change targeting, claims, or acquisition economics before changing the core product. If it exposes a real workflow failure shared by a valuable segment, fix the product and test the effect in that segment.
Follow-up 2: Cancellation surveys say “too expensive,” but usage is also low. What is the cause?
The survey does not distinguish affordability from weak realized value. Compare price exposure, tenure, core-workflow completion, alternatives, and qualitative explanations among churned and retained subscribers. Test different mechanisms separately: a product-value intervention for low-use eligible users and a pause, downgrade, or offer for verified price-sensitive users. The response that improves incremental renewal identifies which mechanism is actionable.
Follow-up 3: Can we remove the holdout after the first successful month?
One month may capture cancellation reversal or payment recovery without showing the next renewal, incentive habituation, or trust harm. Keep a holdout through the precommitted horizon and retain a smaller long-term control when feasible. If withholding an intervention would violate policy or create material customer harm, use a phased rollout or another credible comparison and document the weaker causal certainty.
Follow-up 4: Billing recovery has the largest lift. Should every failed payment receive more retries?
No. Decline reason, processor rules, customer communication, retry cost, chargeback risk, and grace economics differ. Some failures are non-retryable, and repeated attempts can harm trust. Segment the policy, cap attempts and duration, offer a clear payment-update path, and scale only where incremental recovery exceeds cost and guardrails pass.
Follow-up 5: Leadership wants a churn target next quarter. What would you commit to?
Commit to an auditable metric and a portfolio of mechanism-level targets, not a universal benchmark. State the eligible population, baseline range, maturity lag, minimum practical reduction, expected contribution, guardrails, and how much of the 2,400 excess losses each tested mechanism can plausibly address. Separate a near-term goal of returning to the prior comparable range from a long-term structural-retention goal.
Follow-up 6: What if customer churn improves but gross revenue churn worsens?
Inspect which subscribers were retained and whether high-value accounts downgraded or left. A low-price save path can retain more subscriptions while losing recurring revenue and contribution. Decide against the declared objective, report both customer and revenue measures, and revise eligibility or packaging if the program shifts loss rather than creates value.