Ecological validity

In the behavioral sciences, ecological validity is often used to refer to the judgment of whether a given study's variables and conclusions (often collected in lab) are sufficiently relevant to its population (e.g. the "real world" context). Psychological studies are usually conducted in laboratories though the goal of these studies is to understand human behavior in the real-world. Ideally, an experiment would have generalizable results that predict behavior outside of the lab, thus having more ecological validity. Ecological validity can be considered a commentary on the relative strength of a study's implication(s) for policy, society, culture, etc.

This term was originally coined by Egon Brunswik[1] and held a specific meaning. He regarded ecological validity as the utility of a perceptual cue to predict a property (basically how informative the cue is). For example, high school grades have moderate ecological validity for predicting college grades.[2] Hammond[3] argued that the now common use of the term to refer to generality of research results to the "real world" is inappropriate because it robs the original usage of its meaning.

Due to the evolving and broad definition of ecological validity, problematic usage of this term in modern scientific studies occurs because it is often not clearly defined. In fact, in many cases just being specific about what behavior/context you are testing makes addressing ecological validity unnecessary.[4]

  1. ^ Kieffer, Suzanne (2017-06-30). "ECOVAL: Ecological Validity of Cues and Representative Design in User Experience Evaluations". AIS Transactions on Human-Computer Interaction. 9 (2): 149–172. doi:10.17705/1thci.00093. ISSN 1944-3900.
  2. ^ Allensworth, Elaine M.; Clark, Kallie (2020). "High School GPAs and ACT Scores as Predictors of College Completion: Examining Assumptions About Consistency Across High Schools". Educational Researcher. 49 (3): 198–211. doi:10.3102/0013189X20902110.
  3. ^ Hammond, Kenneth R. (September 1998). "Ecological Validity: Then and Now" (PDF). The Brunswik Society. Retrieved March 3, 2024.
  4. ^ Holleman, Gijs A.; Hooge, Ignace T. C.; Kemner, Chantal; Hessels, Roy S. (2020-04-30). "The 'Real-World Approach' and Its Problems: A Critique of the Term Ecological Validity". Frontiers in Psychology. 11: 721. doi:10.3389/fpsyg.2020.00721. ISSN 1664-1078. PMC 7204431. PMID 32425850.