Occam's Razor
27 Oct 2023 11:21
... is not, in any of its commonly-used modern senses, a principle enunciated by William of Occam (or Ockham). (Though how far his rule "Plurality [of entities] is not to multiplied beyond necessity" is from our ideas about preferring simpler theories, or models, or explanations [not the same things, except on accounts in which they are] is a nice question in diachronic semantics.) That we --- i.e., just about anyone reading this page --- have such a preference is very plainly true, but what's less plainly true is that our shared preference has anything to recommend it. Any hope that the truth is simple, or even that simpler theories are (in some incomprehensible sense) more likely to be true, seems flat-out contradicted by experience.
Instead, I am very partial to the idea of Kevin Kelly (disclaimer: a friend) that the Razor is valuable not as a description of the universe, but as a guide to inquiry. That is, by sticking to the simplest theory compatible with the evidence, we converge on the truth faster than if we made up un-necessary complexities. This is nearly the only work on justifying the Razor I know of which doesn't either beg the question, change the subject, or make massive assumptions about the nature of the world, Divine Providence, etc. Unfortunately this correspondence between Occam and efficient convergence on the truth isn't obviously correct, and when Kevin and his collaborators try to prove theorems, there are (so far) some less-than-compelling to features to the way they've had to define key terms like "complexity" and "faster". These feel like solvable complications, however, rather than fundamental difficulties.
- See also:
- Learning, Inference, Induction
- The Minimum Description Length Principle
- Model Selection
- "Occam"-style Bounds for Long Programs
- Scientific Method and Philosophy of Science
- Recommended (rather misc.):
- Pedro Domingos, "The Role of Occam's Razor in Knowledge Discovery," Data Mining and Knowledge Discovery, 3 (1999) [Online]
- Kevin Kelly (et al.), Ockham's Razor and Truth
- William of Occam, Philosophical Writings: A Selection (translated with an introduction and notes by Philotheus Boehner, O.F.M.)
- Tom F. Sterkenburg, "Solomonoff Prediction and Occam's Razor", Philosophy of Science 83 (2016): 459--479, phil-sci/12429
- Conflicted about recommending:
- CRS, "Ockham Workshop", Day 1, Day 2 and Day 3 [The work reported on is excellent, but the report itself is written in a needlessly self-indulgent style]
- To read:
- Kevin T. Kelly
- The Logic of Reliable Inquiry [Includes cartoons by the author]
- "How Simplicity Helps You Find the Truth without Pointing at It"
- "Simplicity, Truth, and the Unending Game of Science" [PDF preprint]
- Elliot Sober, Ockham's Razors: A User's Manual