Discussion about this post

User's avatar
Gavin's avatar

Nice post!

> I disagree with the RCTs-at-all-cost crowd in a few ways.

Yeah, I agree that only accepting evidence from RCTs (particularly when testing interventions that aren't clear cut) is problematic. It reminds of the description of a rationalism from David Chapman's web-book on meta-rationality - placing too much faith in a rational system (RCTs) as a way to establish truths about a messy world: https://metarationality.com/rationalism-definitions

In the case of nutrition RCTs, I suspect one problem is a failure of circumrationality, which is the act of mapping the real world into the formal system behind RCTs (frequentist statistics). As you note, nutritional RCTs don't generally control for a lot of variables (e.g. hormones) that could affect outcomes. That's on the study designers to take care of, the formal statistical tests assume that the participants are randomly sampled from a normally distributed population, and if that isn't the case, then they aren't going to provide results that are representative of the effect of the intervention on the population (one reason there are now calls for more diversity in clinical trials). This article talks a bit about that sort of work: https://metarationality.com/maps-and-territory

Chapman would probably argue for a meta-rational approach to resolving this, which (I think) is accepting that rational systems are almost never perfect, but there might be one or more would useful in any given situation. I don't know what the best alternative to RCTs is for nutrition studies; causal inference may be worth looking into (and Bayesianism is the usual alternative to frequentist statistics).

Aside - Chapman has also written about the failure of nutrition science: https://metarationality.com/nutrition

Expand full comment
Trey Bertram's avatar

Great post! The formula issue came to my attention when I had my first son 2.5 years ago. I was blown away! It’s also worth noting that some of the downsides of US formula has led to a surge in US folks trying to import formula from Europe — https://www.nytimes.com/wirecutter/blog/us-parents-european-baby-formula/.

This stage of development is so critical for babies and can be so stressful for moms. I really hope we can get this right soon.

Expand full comment
2 more comments...

No posts