Most Behavior Change Apps Don't Change Behavior
The evidence on app-based habit formation is less flattering than the industry suggests. What the research actually shows, and what that means for the apps worth using.
In this article7 sections
App disclaimer: DontSnooze makes this app. We have an obvious interest in you believing apps work. Read accordingly.
I want to tell you something the industry I’m part of would prefer I didn’t.
When researchers actually run randomized trials on behavior change apps — the kind where you compare the app against a control group, not against nothing — the results are underwhelming. A 2019 meta-analysis by Linardon and colleagues in Behaviour Research and Therapy reviewed 19 such trials and found an average effect size of d = 0.22. For comparison, in-person cognitive behavioral therapy for the same behaviors produces effects in the d = 0.75–1.0 range. Apps claiming to deliver “CBT in your pocket” are, in the best-studied trials, delivering roughly a quarter of what the in-person version does.
That’s the number. The more interesting question is why — because the reasons are specific enough to matter for choosing which apps to trust.
Why Apps Underperform Their Promise
There are three distinct reasons apps underperform in the behavior-change literature, and they explain different failure modes.
Engagement decay. App engagement for behavior-change applications follows a consistent pattern: high adoption in the first week, sharp dropoff by week four, near-zero for most users by month three. A 2020 analysis of app engagement data by Baumel and colleagues (JMIR Mental Health) found that the median user of a mental health or behavior app completes fewer than four sessions and has dropped off before any sustained behavior change could plausibly occur. The apps aren’t failing. The engagement model is.
Measurement substitution. Many habit apps are optimized for tracking behavior, not changing it. Logging a workout isn’t the same as working out, but after a while the log becomes the reward. The streak is maintained, but the behavior behind it atrophies as users find easier ways to keep the streak green. This is the Goodhart’s Law problem applied to personal habits: when the measure becomes the target, it stops being a good measure.
Motivation mismatch. Apps that rely on intrinsic motivation — you want to change, you use the app to help yourself do it — are effective only for people who already have sufficient intrinsic motivation to change without the app. The people most likely to download a habit app are often the people who already care enough to act; the intervention reaches the people who need it least.
What Actually Works in the App-Based Evidence
The literature is not uniformly negative. Some specific app features correlate with sustained behavior change across multiple studies.
Social commitment features. Apps that allow users to make commitments visible to specific known people — not anonymous communities, specific named contacts — consistently outperform apps that track behavior privately. A 2021 review by Harkin and colleagues in Psychological Bulletin found that self-monitoring alone had modest effects; self-monitoring combined with feedback from a real social contact had significantly larger effects. The social layer is doing most of the work.
Immediate, automatic consequences. Apps where failure is immediately visible to others, without a delay for self-reporting, outperform apps that rely on the user to share their results. The behavioral research on commitment devices (Ariely & Wertenbroch, 2002, Psychological Science) consistently finds that removing the opportunity to reframe failure before reporting it strengthens the behavior-change effect. Automatic visibility is a feature, not a privacy violation.
Friction asymmetry. Apps that make compliance easy and non-compliance visible perform better than apps that make compliance conspicuous and non-compliance private. Most apps get this backward: they require you to log your good behavior (friction on compliance) while doing nothing when you don’t log (no friction on non-compliance). The effective design is inverted: compliance requires minimal action; non-compliance is automatically flagged.
The Implication for Choosing an App
If you’re evaluating whether any behavior change app will work for you, three questions cut through most marketing claims:
-
Does it require anyone else to know your result? If the answer is no, it’s a tracking app, not an accountability app. Tracking is useful but does not produce the effect that’s typically being promised.
-
Does it make non-compliance automatic and visible? If failure only becomes visible when you report it, the app has designed in the rationalization window. The strongest apps close that window.
-
Does it work even when you don’t open it? Apps that require active engagement to produce their effect will lose to engagement decay by month two. Apps that work by creating automatic social consequences don’t require you to open them.
Most apps on the market fail at least one of these. Some fail all three while having excellent UX and five-star reviews from users who haven’t yet hit month two.
FAQ
Are there any behavior change apps that have strong RCT evidence?
Yes, a small number. Apps with demonstrated effect sizes across multiple RCTs include several digital CBT programs (Woebot, for depression and anxiety; Sleepio, for insomnia — both d > 0.4), and a small number of smoking cessation apps with NRT integration. The evidence base for general habit/productivity apps is significantly weaker. The market does not reward evidence-based design proportionally to design quality, so the best-evidenced apps are often not the most popular ones.
Why do habit apps with millions of users often lack RCT evidence?
Large user bases and strong evidence are independent properties, and the incentives to generate evidence are weak. An RCT requires comparing your product to a control condition, which means publishing data on how much better (or not) your product performs versus nothing. Most app companies have no interest in publishing that data. User count is a marketing metric; effect size is a clinical one. The two don’t correlate.
Is any amount of app use better than nothing for behavior change?
Probably marginally, based on the meta-analytic literature. A d = 0.22 effect is small but real. The question is whether the marginal benefit of an average app outweighs the opportunity cost of relying on it — specifically, whether believing you’re managing the behavior via app reduces the likelihood of investing in higher-effect interventions like genuine social commitment, environmental redesign, or professional behavior change support.