One other method can be employed to judge the validity of the hypotheses that dietary fat or saturated fat causes heart disease, and that cholesterol-lowering diets prevent it. This is a technique known as meta-analysis, viewed as a kind of last epidemiological resort in these kinds of medical and public-health controversies: if the existing studies give ambiguous results, the true size of a benefit or harm may be assessed by pooling the data from all the studies in such a way as to gain what’s known as statistical power. Meta-analysis is controversial in its own right. Investigators can choose, for instance, which studies to include in their meta-analysis, either consciously or subconsciously, based on which ones are most likely to give them the desired result.
For this reason, a collaboration of seventy-seven scientists from eleven countries founded the Cochrane Collaboration in 1993. The founders, led by Iain Chalmers of Oxford University, believed that meta-analyses could be so easily biased by researchers’ prejudices that they needed a standardized methodology to minimize the influence of such prejudice, and they needed a venue that would allow for the publication of impartial reviews. The Cochrane Collaboration methodology makes it effectively impossible for researchers to influence a meta-analysis by the criteria they use to include or exclude studies. Cochrane Collaboration reviews must include all studies that fit a prespecified set of criteria, and they must exclude all that don’t.
In 2001, the Cochrane Collaboration published a review of “reduced or modified dietary fat for preventing cardiovascular disease.” The authors combed the literature for all possibly relevant studies and identified twenty-seven that were performed with sufficient controls and rigor to be considered meaningful.*26 These trials encompassed some ten thousand subjects followed for an average of three years each. The review concluded that the diets, whether low-fat or cholesterol-lowering, had
If we believe in Rose’s philosophy of preventive medicine, this suggestion of benefit or the possibility that even a “small” benefit was missed still constitutes sufficient motivation to advocate cholesterol-lowering diets to the entire population, as indeed the authors of the first Cochrane review suggested. We could also assume that if a suggestion of a benefit can be induced after two years on such a diet, we might do considerably better after ten or twenty years, although we would still need trials to test that assumption.
We might also compare this conclusion to the original predictions of Keys’s hypothesis in the mid-1950s. When Keys first suggested that eating fat caused heart disease, as we discussed, he did so partly on the basis of the experience in wartime Europe, where food shortages of a few years’ duration coincided with
THE CARBOHYDRATE HYPOTHESIS