Austin Bradford Hill: Scientific Observation and Experiment are Linked, 1953
This highly quotable classic was given as the Cutter Lecture on Preventive Medicine at the Harvard School of Public Health on March 25, 1953. Hill introduced his ideas as a partial antidote to a preceding Cutter lecture by the Oxford nutritionist Hugh Sinclair, who maintained that: “the use of the experimental method has brilliant discoveries to its credit, whereas the method of observation has achieved little” (Hill 1953, 995).
Hill, the great advocate and pioneer designer of randomized experiments (RCT) indicates, nevertheless, how so few of lifestyle and environmental effects on health are amenable to experiment. Accordingly he lays out a map for rendering observational studies as much as possible like experiments, with efforts to sharpen data collection and reduce biases, all the while seeking, as his colleague Greenwood wished, “permeation of statistical research with the experimental spirit. In other words, can observations be made in such a way as to fulfill, as far as possible, experimental requirements” (ibid.).
Presciently, he warns that, “the methods of partial correlation, enthusiastically accepted a quarter of a century ago, no longer seem to have an ‘unlimited power to penetrate the secrets of nature’” (ibid.). Then he illustrates how the powerful observations of John Snow on the distribution of London cholera led him to the “natural experiment” of the rival companies supplying water to the populace. “… Such “experiments” or, at the least, effective “controls” would not … Really prove to be so rare if one invariably cast one’s eyes round for them after vital statistics, or similar observation, had given an appropriate lead” (ibid. 996). [Ancel Keys, stung early by tough critiques of his ecological observations on diet and coronary disease, turned to the natural experiments provided by centuries of differing traditional diets.]
Hill asks pointedly, in reply to the statistics naysayers, “how many researches which have led to real advances in medicine would ever have been started had there not first been some statistics to suggest that here was a problem to be investigated?” (ibid. 998).
The advances by such pioneers in CVD epidemiology as Gofman and Keys illustrate how perceptively and fearlessly they trod both paths, observation and experiment. As Hill maintains: “There are … no grounds for antagonism between experiment and observation. The former, indeed, depends on observation but of a type that has the good fortune to be controlled at the experimenter’s will. In the world of public health and preventive medicine each will–or should–constantly react beneficially upon the other. Observation in the field suggests experiment; the experiment leads back to more, and better defined, observations.”
But Hill holds out for the greater task or talent of the observer: “The observer may well have to be more patient than the experimenter–awaiting the occurrence of the natural succession of events he desires to study; he may well have to be more imaginative–sensing the correlations that lie below the surface of his observations; and he may well have to be more logical and less dogmatic–avoiding as the evil eye the fallacy of post hoc ergo propter hoc, the mistaking of correlation for causation”(ibid. 1000). His colleague, William Topley, suggests that the worker at the bench, the clinician in the ward, and the epidemiologist in the field are all making experiments, “all shading through almost imperceptible stages of increasing intervention into the fully developed experiment in the laboratory” (ibid).
We have seen, fifty years later, a vigorous return to this fundamental concept with an innovative strategy to reformulate the observational design of a prospective study that showed an apparently favorable effect (of hormone replacement therapy) as close as possible to the conditions of a trial of the same therapy (Womens’ Health Initiative HRT trial), yielding the same null results as the trial (on cardiovascular risk in that momentous experiment) (Hernan et al. 2008). (Henry Blackburn)
Resources
Hill, A. Bradford. 1953. Observation and experiment. New England Journal of Medicine 248; 995-1001.
Hernán, M.A., Alonso, A., Logan, R., Grodstein, F., Michels, K.B., Willett, W.C., Manson, J.E., Robins, J.M. 2008. Observational studies analyzed like randomized experiments: an application to postmenopausal hormone therapy and coronary heart disease. Epidemiology. 2008 Nov;19(6):785-8.