"There are unknown unknowns" is a phrase from a response United States Secretary of Defense Donald Rumsfeld gave to a question at a U.S. Department of Defense (DoD) news briefing on February 12, 2002, about the lack of evidence linking the government of Iraq with the supply of weapons of mass destruction to terrorist groups.[1] Rumsfeld stated:
Reports that say that something hasn't happened are always interesting to me, because as we know, there are known knowns; there are things we know we know. We also know there are known unknowns; that is to say we know there are some things we do not know. But there are also unknown unknowns—the ones we don't know we don't know. And if one looks throughout the history of our country and other free countries, it is the latter category that tends to be the difficult ones.[1]
The statement became the subject of much commentary. In The Decision Book (2013), author Mikael Krogerus refers to it as the "Rumsfeld matrix".[2] The statement also features in a 2013 documentary film, The Unknown Known, directed by Errol Morris.[3]
Known unknowns refers to "risks you are aware of, such as canceled flights",[4] whereas unknown unknowns are risks that come from situations that are so unexpected that they would not be considered.
With respect to awareness and understanding, unknown unknowns can be compared to other types of problems in the following matrix:
Aware | Not aware | |
---|---|---|
Understand | Known knowns: Things we are aware of and understand |
Unknown knowns: Things we are not aware of but do understand or know implicitly |
Don't understand | Known unknowns: Things we are aware of but don't understand |
Unknown unknowns: Things we are neither aware of nor understand |