Prompt and Applicable Scenarios
A consumer marketplace sends account-security alerts, order and delivery updates, buyer-seller messages, recommendations, and promotions. After campaign teams increased outbound volume, complaints and all-notification opt-outs rose. Notifications still help users respond to fraud warnings, coordinate a delivery, and answer transaction-related messages on time.
You have eight weeks for an MVP. Design the notification product strategy, user controls, decision policy, measurement plan, experiment, and rollout. The prompt does not provide causal proof that volume created the complaints, so diagnosis comes before solution selection. The eight-week limit and notification categories are interview-case constraints, not universal benchmarks.
The product goal is not to maximize sends, opens, clicks, or time in the app. It is to increase the number of useful, timely user outcomes per interruption while preserving consent and trust. This is a product question because the decisive work is choosing users, jobs, policies, metrics, and trade-offs; queueing and delivery infrastructure are out of scope.
What the Interviewer Evaluates
First, can the candidate replace a proxy with a user outcome? A campaign can raise click-through rate by sending more messages while users silence the app. A strong answer distinguishes “opened a notification” from “completed the task the notification was meant to enable.”
Second, can they classify notifications by user consequence and cost of delay? A fraud alert, a courier arriving, a buyer message, a recommendation, and a promotion should not compete under one score or frequency cap. Strong candidates protect truly time-sensitive events without labeling every business request urgent.
Third, do they design a policy rather than a list of features? Eligibility, deduplication, current-context suppression, priority, channel, timing, bundling, limits, and user preference form one decision sequence. A digest alone cannot fix irrelevant targeting; a frequency cap alone can accidentally suppress a security alert.
Fourth, do they preserve user agency? Permission should be requested in context, categories should be understandable, marketing needs explicit consent where required, and the product must offer a usable preference center instead of forcing an all-or-nothing choice.
Finally, can they validate causality and manage organizational incentives? Each campaign team sees its own clicks but users experience the combined interruption load. The PM needs user-level experiments, cross-category guardrails, a central policy owner, and an exception process that cannot become a permanent bypass.
Clarifying Questions Before Answering
- Which user and business outcomes matter? If the priority is fraud response, the plan protects response time. If it is order completion, the event taxonomy and success window change.
- What proves fatigue? Category opt-outs, all-notification disablement, complaints, repeated dismissals, and declining retained use point to different causes. A raw send increase alone is not enough.
- Which categories are contractual or safety-critical? A mandatory account-security notice needs a different channel and policy from an optional recommendation.
- Who triggers each message? Transaction events, other users, recommendation models, and scheduled campaigns need different deduplication and expiry rules.
- Which channels are in scope? Push, email, SMS, and in-app inbox have different interruption costs, consent rules, latency, and delivery certainty.
- Can the system observe user context? If it knows the user has already read a message on another device, it can suppress or withdraw a stale alert. Without that signal, the MVP needs a simpler rule.
- How do current preferences work? An all-or-nothing switch calls for category controls; an existing preference center may have discoverability or enforcement failures instead.
- What can eight weeks realistically change? If a centralized decision service does not exist, the first release should use enforceable rules and logging rather than promise perfect personalization.
30-Second Answer Framework
“I would first verify where fatigue occurs by category, segment, and cumulative exposure, then define the outcome each notification should enable. I would separate security and time-sensitive transaction updates from conversations, recommendations, and marketing.
For an eight-week MVP, every candidate notification passes eligibility, expiry, deduplication, context-suppression, priority, user-preference, quiet-hour, and frequency rules. Critical messages bypass ordinary caps only under a narrow audited policy; low-urgency content is bundled into a digest. Users choose understandable categories when the value is clear.
I would randomize eligible users on the noncritical policy and measure incremental timely task completion per 100 interruptions, with category and all-notification opt-outs, complaints, retention, and missed critical actions as guardrails. I would roll out by category and segment, not all at once.”
Step-by-Step Deep Dive
Step 1: Verify the problem at the user level
Start with a send ledger that joins notification candidates, policy decisions, delivery, display, dismissal, open, downstream task completion, preference changes, complaints, and retained product use. Analyze cumulative exposure per user, not only campaign averages. Ten teams each sending one “reasonable” campaign can create an unreasonable day.
Break the evidence down by notification category, user lifecycle, marketplace role, operating system, locale, and baseline activity. Compare people at similar activity levels who receive different loads, but do not treat that observational comparison as causal proof. Interview or survey users who disabled a category and sample actual message histories. Common diagnoses include irrelevant targeting, duplicates, stale alerts, bad timing, misleading urgency, a task that was already completed elsewhere, and an unclear path to control.
Separate delivery failure from product failure. A notification that was never displayed cannot be judged by click-through. A displayed alert that enables the user to complete an order from the lock screen may be valuable even if app time falls. A high open rate followed by immediate exit can mean the notification worked efficiently or that it used a misleading hook; downstream task state distinguishes them.
Step 2: Create a consequence-and-urgency taxonomy
Classify each category with four questions:
- What user job does this message enable?
- What harm occurs if the user never sees it?
- How quickly does its value decay?
- Did the user request or explicitly consent to this category?
Use that evidence to define a small policy taxonomy:
| Class | Marketplace example | Default treatment |
|---|---|---|
| Security | Suspicious account access | Immediate, private copy, narrow override policy |
| Time-sensitive transaction | Courier arriving or payment action required | Immediate within the real action window |
| Conversation | Buyer-seller message | Immediate or bundled according to user and thread context |
| Informational | Order milestone with no action required | Quiet delivery or digest |
| Recommendation | Relevant item suggestion | Personalized limit and quiet hours |
| Marketing | General promotion | Explicit consent, strict limit, easy category opt-out |
Urgency is based on user consequence, not the requesting team's launch date. Apple distinguishes passive, active, time-sensitive, and critical interruption levels and warns against assigning high urgency to low-priority information. The marketplace can use its own product taxonomy while respecting platform behavior and permission boundaries.
Step 3: Turn the taxonomy into one decision policy
For each candidate notification, evaluate in this order:
- Eligibility: Is the event real, current, relevant to this user, and allowed by consent and policy?
- Expiry and deduplication: Has the task expired, already completed, or been represented by another pending notification?
- Context suppression: Is the user already viewing the relevant conversation or did another device complete the task?
- Priority and channel: What is the cost of delay, and is push the least disruptive channel that meets it?
- Preference and quiet hours: Has the user allowed this category and timing?
- Budget and bundling: Does the category consume an interruption now, wait for a digest, move to an in-app inbox, or get dropped?
- Content and destination: Does the message explain why it matters, avoid sensitive lock-screen data, and open the exact task state?
Apply limits at both category and user level. A category limit stops one campaign from flooding; a total noncritical budget prevents several teams from combining into overload. Security and narrowly defined time-sensitive transaction messages do not compete for the ordinary marketing budget, but every override records a reason, owner, and expiry. Otherwise “critical” becomes an escape hatch.
Use rules before machine-learning personalization in the MVP. Rules make consent, urgency, and safety behavior explainable. A later ranking model may prioritize eligible noncritical candidates, but it cannot override permission, privacy, expiry, or reserved critical capacity.
Step 4: Scope an eight-week MVP around preventable waste
Do not start by rebuilding every sender. Instrument the common decision point and choose the two or three categories causing most avoidable interruptions. The MVP should include:
- a shared category and urgency registry with an accountable owner for each type;
- event IDs, expiry, task destination, and deduplication keys for selected categories;
- suppression when a task is complete or the relevant surface is active, where signals already exist;
- quiet hours, a total noncritical budget, and digesting for eligible informational content;
- an in-product preference center with plain-language category controls;
- a decision log that records sent, delayed, bundled, suppressed, and dropped outcomes without sensitive message content.
Keep infrastructure ambition bounded. If withdrawing a delivered cross-device alert is unavailable, suppress future duplicates and mark withdrawal as a later capability. If a sender cannot supply expiry or task identity, it does not receive high-priority treatment until it satisfies the contract. The policy becomes enforceable because participation has explicit requirements.
Step 5: Design consent, controls, and the notification experience
Ask for operating-system permission when the user reaches a moment that demonstrates value—for example, after placing an order, explain that enabling notifications can provide delivery updates. Android's guidance recommends requesting permission in context and explaining what will be sent. A generic permission prompt at first launch asks for trust before value exists.
The preference center should use user jobs, such as “order and delivery updates,” rather than internal campaign names. Show channel, timing, and urgency where those choices matter. Marketing consent stays separate from necessary service communication. Respect operating-system choices; repeatedly pressuring a user who denied permission is not a recovery strategy.
Each notification should be concise, identify the relevant order or conversation without exposing confidential details, and deep-link to a current state. Avoid repeating the same event. When the app is already showing the information, update that surface quietly instead of issuing another interruption. A stale notification should be withdrawn when supported or lead to a state that explains the task is already complete.
Step 6: Measure useful outcomes rather than raw clicks
A useful primary metric is incremental timely task completions per 100 delivered interruptions for the categories being changed. Its numerator can be fraud reviews completed within the safe window, delivery actions completed before arrival, or buyer messages answered within the marketplace's defined response window. The metric is computed by category; combining a promotion click with a security response hides the trade-off.
Pair it with a measurement tree:
- Outcome: incremental completed task, completed order, or resolved conversation attributable to the policy;
- Efficiency: delivered interruptions per incremental outcome, duplicate rate, and expired-alert rate;
- Trust: category opt-out, all-notification disablement, complaints, and permission denial;
- Long-term: retained marketplace use and repeat transaction behavior;
- Safety: missed or late critical actions, fraud loss indicators, and failed service communication;
- Business: incremental margin or transaction value, never raw click-through alone.
Randomize eligible users into the current policy and the proposed noncritical policy. Keep assignment stable so cumulative fatigue can emerge, and run across a normal product cycle rather than stopping when clicks move. Do not withhold a required security alert for an experiment. For critical categories, test safe presentation or routing variants, shadow-classify urgency, and use operational validation within the required delivery boundary.
Interpret suppressed sends correctly. Total opens may fall because fewer notifications exist. If timely tasks remain stable, opt-outs decline, and interruptions per outcome improve, that is a product win. If clicks rise but task completion does not, the policy may be optimizing curiosity rather than value.
Step 7: Roll out with cross-category guardrails
Start in shadow mode: record what the new policy would suppress or bundle without changing delivery. Review false suppressions with operations, security, support, and category owners. Then enable one low-risk category for a small eligible segment, followed by broader noncritical categories. Expand only after outcome and trust guardrails pass.
Define rollback before launch. A rise in missed delivery actions, delayed fraud response, duplicate complaints, or preference-enforcement errors pauses the rollout. A kill switch can restore the previous policy for one category without disabling the entire notification system.
Create governance that matches the user experience. One owner maintains taxonomy, user-level budgets, and the experiment readout. Category teams own relevance and task definitions. Exceptions require a user consequence, duration, approver, and automatic expiry. Report incremental outcomes and trust costs by team so local click gains cannot hide global opt-outs.
Step 8: Test the policy against adversarial cases
Before launch, walk through:
- five campaign teams scheduling sends in the same hour;
- duplicate order events arriving with different timestamps;
- a message read on desktop before mobile delivery;
- a courier alert whose action window has already closed;
- a user traveling across time zones during quiet hours;
- a new user who has not granted operating-system permission;
- a promotion mislabeled as time-sensitive to bypass a budget;
- sensitive order or account information visible on a locked screen;
- push disabled while email and the in-app inbox remain available;
- a preference change racing with a queued campaign.
For each case, name the expected decision, user-visible result, log record, and owner. Test both false positives—useful messages suppressed—and false negatives—wasteful or impermissible messages sent. A policy that only reduces volume but misses urgent user tasks has failed the prompt.
Strong Sample Answer
“I would frame fatigue as a user-level allocation problem. The security team, order team, messaging team, and growth team each see one campaign, but the user experiences their combined interruptions. I would first join candidate, delivery, action, preference, complaint, and retention events to find which categories and segments create preventable waste.
Then I would classify notifications by the user job and cost of delay. Fraud alerts and expiring delivery actions get reserved treatment. Conversations respect thread and active-device context. Informational updates can be bundled, while recommendations and promotions use explicit consent, quiet hours, and a shared noncritical budget.
In eight weeks, I would implement the taxonomy, expiry and dedupe contracts for the highest-waste categories, task-complete suppression where signals already exist, digesting, plain-language preferences, and a central decision log. Every override would have an owner and expiry.
For noncritical traffic, I would use stable user-level randomization. The primary metric would be incremental timely task completions per 100 interruptions. Opt-outs, complaints, retained use, and missed critical actions would be guardrails. I would shadow first, launch one low-risk category, and expand only if useful outcomes hold while interruption cost falls.”
Common Mistakes
- Optimizing click-through rate → More or more provocative messages can raise clicks while exhausting trust → Measure incremental task outcomes and interruption cost.
- Applying one global frequency cap → A promotion may consume the slot needed by a fraud alert → Reserve narrow critical classes and cap noncritical traffic separately.
- Calling every transaction message urgent → Internal importance is not user urgency → Require a concrete user harm and decay window for overrides.
- Launching only a digest → Irrelevant, stale, and duplicate content remains wasteful inside a bundle → Fix eligibility and deduplication before bundling.
- Asking for permission on first launch → The user has not seen the value they are authorizing → Request in context and explain the categories.
- Offering only an all-or-nothing switch → Users silence useful service messages to escape promotions → Provide understandable category controls and separate marketing consent.
- Personalizing before establishing policy → A model can amplify bad labels and obscure consent failures → Make hard constraints explicit, then rank only eligible noncritical candidates.
- Running a notification-level experiment → Treatments leak across the same user's cumulative experience → Randomize stably at user level.
- Stopping when short-term clicks improve → Fatigue and opt-outs accumulate over time → Run through a normal product cycle and inspect lagging trust metrics.
- Letting teams self-declare exceptions → Every launch gradually becomes critical → Use a central registry, audit trail, approver, and automatic expiry.
Follow-Up Questions and Answers
What if click-through falls by 20% but task completion and retention improve?
That can be the intended result because fewer low-value notifications remain. Verify instrumentation, category mix, and experiment balance, then compare incremental task completion per interruption, opt-outs, and business outcomes. Do not restore waste merely to recover a proxy.
Should security alerts bypass every user setting and limit?
Only legally or contractually required communication and narrowly defined security events should receive reserved treatment. Even then, minimize content, choose the least disruptive effective channel, prevent duplicates, and audit the override. The product cannot casually override operating-system permission or platform rules.
What if the growth team says a promotion is time-sensitive because it expires tonight?
A business deadline does not create user harm when the message is missed. Keep it in the marketing class, subject to consent, quiet hours, and noncritical budgets. If a promotion is tied to an active user-requested workflow, evaluate that workflow separately instead of relabeling the entire campaign.
What if most users have denied push permission already?
Do not repeatedly nag them. Improve the in-app inbox and use consented email where appropriate, then ask for push only at a value-relevant moment. Measure whether people understand the benefit and category choices; permission rate alone is not the objective.
When would you add a personalization model?
After event identity, expiry, consent, preferences, and outcome labels are reliable. The model may rank eligible noncritical candidates or choose digest content. It must not override hard policy, and evaluation must include cold-start users, sparse segments, calibration, and opt-out effects—not only click prediction.
How do you prevent duplicate push, email, and in-app messages?
Assign one task or event identity across channels, record channel decisions, and stop escalation after the user completes the task. Define when a cheaper or less interruptive channel gets the first chance and when lack of response justifies escalation. Delivery uncertainty is not permission to send every channel at once.
What if completed orders decline after reducing promotions?
Check whether the decline is incremental, which users and categories drive it, and whether the policy suppressed relevant intent rather than noise. Restore or redesign the affected category within the experiment while preserving global limits. The decision weighs durable transaction value and trust cost, not a blanket “less is better” rule.
How would you handle a sender that cannot provide expiry or a deduplication key?
It should not receive high-priority or override privileges. Route it to a conservative noncritical policy, instrument the resulting waste, and require the missing contract before expansion. This turns product governance into an enforceable entry condition instead of documentation nobody follows.