122 Trials, One Technique: What Reviews of Food Diaries and Self-Weighing Say About Tracking

Michie et al. (2009) pooled 122 trials and found self-monitoring explained the most variation; Burke et al. (2011) found logs that may be filled in later.

In this article6 sections

In the 122 evaluations that Susan Michie and colleagues pooled in 2009, one technique accounted for more of the differences between studies than any other: self-monitoring. Interventions that paired it with at least one other technique from control theory had an average effect of 0.42, against 0.26 for the rest. Writing things down seems to help, mostly when something is done with what you wrote, and the evidence that the writing is honest is thinner than the evidence that it helps.

What did Michie and colleagues find?

The paper, “Effective techniques in healthy eating and physical activity interventions: a meta-regression,” appeared in Health Psychology (2009, volume 28, pages 690-701). The team gathered 122 evaluations covering 44,747 participants, all aimed at getting adults to eat better or move more. The authors classified the content of each intervention into 26 behavior-change techniques (the abstract says reliably), then used meta-regression to ask which techniques went with larger effects.

The pooled effect across everything was 0.31 (95% confidence interval 0.26 to 0.36), with a lot of spread between studies (I² = 69%). Self-monitoring explained the greatest share of that spread, 13%. Interventions that combined it with at least one other technique “derived from control theory” scored 0.42 against 0.26 for the others. I read the abstract through the Europe PMC database; the full text was behind a paywall, so I cannot tell you from the paper itself which other techniques counted, and I will not guess.

A caveat belongs next to the number. Meta-regression compares studies, and studies that chose to include self-monitoring and a second technique may also differ in sample, setting or effort. It points at promising ingredients; it does not prove that adding a notebook to a program adds 0.16 to its effect.

What does a food-diary literature look like up close?

Lora Burke, Jing Wang and Mary Ann Sevick reviewed the narrower field of weight loss in the Journal of the American Dietetic Association (2011, volume 111, pages 92-102). They found 22 studies published between 1993 and 2009: 15 on dietary self-monitoring, six on self-weighing, one on exercise. The paper diary was the most common tool.

The associations are consistent. In the studies the review summarizes, consistency of recording tracked with weight change at around r = 0.35 in absolute size in Boutelle’s 1999 sample of 57 people, and the number of diaries submitted correlated with weight loss at r = -0.50 in a 2001 trial by Tate and colleagues (a negative sign here means more diaries, less weight). A large 2008 study by Hollis and colleagues, 1,685 people, also tied the number of diaries submitted to weight loss. On self-weighing, Butryn and colleagues’ 2007 study of 3,003 members of a weight-loss registry found that people who weighed themselves less over a year gained 4.0 kg on average, against 1.1 kg for people who weighed more often.

Then comes the authors’ own grading: “the level of evidence was weak.” Most studies were descriptive. The samples were mostly white women. And the part I would underline for anyone who tracks anything: adherence was typically self-reported, and the only study that measured dietary self-monitoring objectively found little agreement between self-report and the device, with evidence of what the authors call “backfilling,” meaning entries completed later. The review also says the dose is unknown: nobody has established how much self-monitoring is enough.

Why does it matter when the entry gets made?

A person who skips breakfast tracking for three days and reconstructs it on Thursday night is not lying in any dramatic way. The entry is an estimate, filled in by someone who now knows the week they want to have had. A related effect shows up whenever a log is also the thing being judged; Goodhart’s law describes how a measure bends once it becomes the target.

There is also a motivation confound hiding in the correlations. People who keep a diary faithfully for twelve weeks are probably people who were going to lose weight anyway. The reviews cannot separate the habit of recording from the habit of caring. That is one reason I would not read these numbers as “log more, lose more.”

A 2016 meta-analysis by Harkin and colleagues in Psychological Bulletin (138 randomized studies, N = 19,951) found that progress monitoring promoted goal attainment (d+ = 0.40) and had larger effects when outcomes were reported or made public and when the information was physically recorded. Taken alongside Michie, the pattern is that a record made at the time, and seen by another person, is more likely to help. The two papers measured different outcomes in different trials, so treat that as a pattern and not a result.

What does this mean for a morning log?

A first-person month of logging every snooze is a sample of one, but it matches the shape of the reviews: noting the snoozes helped somewhat, and texting the log to a friend helped more. A proof hierarchy ranks kinds of record by how easily they can be adjusted after the fact.

For the wake-up case specifically, the clean version of the idea is a record that cannot be backfilled: something created at the moment the alarm sounds that other people can see. DontSnooze is built around that idea, as the how-it-works page describes: you record a short video when the alarm fires and your group sees it. No trial has tested whether that format beats a private log for waking up. What the reviews above support is narrower, namely that timing and an audience are plausible reasons it might.

Limits of what these reviews can say

  • Both papers concern eating, weight and physical activity, not sleep or waking. Whether the same pattern holds for getting out of bed is an extrapolation.
  • Michie’s 0.42 versus 0.26 compares groups of studies. It is not a randomized comparison of notebooks.
  • Burke’s correlations come mostly from people already enrolled in weight-loss programs, mainly white women, so they say little about men or about people not in a program.
  • I did not reach either full text through the publishers. The Michie details come from its abstract, and the Burke figures come from the open-access copy in PubMed Central through a tool-generated summary rather than a page-by-page read, so a reader quoting specific r values should check them against the paper.

Quick answers on self-monitoring

Does tracking a habit work without any other changes? The evidence reviewed here does not isolate it. Michie and colleagues (2009) found self-monitoring was linked to better results mainly when it came with at least one other control-theory technique: 0.42 for that combination against 0.26 for the other interventions. Burke and colleagues (2011) found consistent associations between logging and weight loss, but rated the evidence weak because most studies were descriptive. A log with nothing done about what it shows is the least-supported case.

How do researchers know whether a diary is accurate? Mostly they do not. Burke and colleagues report that adherence was usually self-reported, and that the only study to measure dietary self-monitoring objectively found little agreement between what people said they recorded and what the device showed, including entries filled in after the fact. A diary tells you what a person chose to write, so a timestamp made at the moment of the behavior is worth more than a tidy page.

Is there a famous case of a daily number holding steady? One often-told story is Fred Rogers weighing in at 143 pounds each morning, though the sources for it are secondhand, as a short note on that scale explains. How often do I need to check or log for it to matter? Nobody knows. Burke and colleagues list the required frequency as an open question. Studies in their review tied weight loss to how consistently people recorded, or how often they weighed in, but those are associations between people who differ in motivation, not a tested dose. Pick a schedule you can keep and watch whether the record still gets made in week six.

Keep reading