Occam's Razor
Last update: 04 Jan 2025 14:24First version: 23 June 2016
... is not, in any of its commonly-used modern senses, a principle enunciated by William of Occam (or Ockham). (Though how far his rule "Plurality [of entities] is not to multiplied beyond necessity" is from our ideas about preferring simpler theories, or models, or explanations [not the same things, except on accounts in which they are] is a nice question in diachronic semantics.) That we --- i.e., just about anyone reading this page --- have such a preference is very plainly true, but what's less plainly true is that our shared preference has anything to recommend it. Any hope that the truth is simple, or even that simpler theories are (in some incomprehensible sense) more likely to be true, seems flat-out contradicted by experience.
Instead, I am very partial to the idea of Kevin Kelly (disclaimer: a friend) that the Razor is valuable not as a description of the universe, but as a guide to inquiry. That is, by sticking to the simplest theory compatible with the evidence, we converge on the truth faster than if we made up un-necessary complexities. This is nearly the only work on justifying the Razor I know of which doesn't either beg the question, change the subject, or make massive assumptions about the nature of the world, Divine Providence, etc. Unfortunately this correspondence between Occam and efficient convergence on the truth isn't obviously correct, and when Kevin and his collaborators try to prove theorems, there are (so far) some less-than-compelling to features to the way they've had to define key terms like "complexity" and "faster". These feel like solvable complications, however, rather than fundamental difficulties.
- See also:
- Complexity Measures
- Learning, Inference, Induction
- The Minimum Description Length Principle
- Model Selection
- "Occam"-style Bounds for Long Programs
- Scientific Method and Philosophy of Science
- Recommended, big picture:
- Pedro Domingos, "The Role of Occam's Razor in Knowledge Discovery," Data Mining and Knowledge Discovery, 3 (1999) [PDF reprint via Prof. Domingos]
- Kevin Kelly (et al.), Ockham's Razor and Truth [and Kevin's various papers with collaborators, linked through there]
- William of Occam, Philosophical Writings: A Selection (translated with an introduction and notes by Philotheus Boehner, O.F.M.)
- Recommended, close-ups:
- Konstantin Genin, The Topology of Statistical Inquiry [Ph.D. dissertation, CMU, 2018; I was on Kasey's committee.]
- Tom F. Sterkenburg, "Solomonoff Prediction and Occam's Razor", Philosophy of Science 83 (2016): 459--479, phil-sci/12429
- Not fully recommended:
- Jacob Feldman, "How surprising is a simple pattern? Quantifying 'Eureka!'," Cognition 93 (2004): 199--224 [Comments]
- Conflicted about recommending:
- CRS, "Ockham Workshop", Day 1, Day 2 and Day 3 [The work reported on is excellent, but the report itself is written in a needlessly self-indulgent style]
- To read:
- Kevin T. Kelly, The Logic of Reliable Inquiry [Includes cartoons by the author]
- Elliot Sober, Ockham's Razors: A User's Manual