All Topics  
Parsimony

 

   Email Print
   Bookmark   Link






 

Parsimony



 
 
Parsimony is a 'less is better' concept of frugality
Frugality

Frugality is the practice of# acquiring goods and services in a restrained manner, and# resourcefully using already owned economic goods and services, to...
, economy or caution in arriving at a hypothesis or course of action. The word derives from Middle English parcimony, from Latin parsimonia, from parsus, past participle of parcere: to spare. It is a general principle that has applications from science to philosophy and all related fields. Parsimony is essentially the implementation of Occam's razor
Occam's razor

Occam's razor, also Ockham's razor, is a principle attributed to the 14th-century English logician and Franciscan friar, William of Ockham....
.

a class="link1" onMouseover='showByLink("m2458767",this)' onMouseout='hide("m2458767")'href="http://www.absoluteastronomy.com/topics/Science">science
Science

In its broadest sense, science refers to any systematic knowledge or practice. In its more usual restricted sense, science refers to a system of acquiring knowledge based on scientific method, as well as to the organized body of knowledge gained through such research....
, parsimony is preference for the least complex explanation for an observation.






Discussion
Ask a question about 'Parsimony'
Start a new discussion about 'Parsimony'
Answer questions from other users
Full Discussion Forum



Encyclopedia


Parsimony is a 'less is better' concept of frugality
Frugality

Frugality is the practice of# acquiring goods and services in a restrained manner, and# resourcefully using already owned economic goods and services, to...
, economy or caution in arriving at a hypothesis or course of action. The word derives from Middle English parcimony, from Latin parsimonia, from parsus, past participle of parcere: to spare. It is a general principle that has applications from science to philosophy and all related fields. Parsimony is essentially the implementation of Occam's razor
Occam's razor

Occam's razor, also Ockham's razor, is a principle attributed to the 14th-century English logician and Franciscan friar, William of Ockham....
.

Science

In science
Science

In its broadest sense, science refers to any systematic knowledge or practice. In its more usual restricted sense, science refers to a system of acquiring knowledge based on scientific method, as well as to the organized body of knowledge gained through such research....
, parsimony is preference for the least complex explanation for an observation. This is generally regarded as good when judging hypotheses
Hypothesis

A hypothesis consists either of a suggested explanation for an observable phenomenon or of a reasoned proposal predicting a possible causal correlation among multiple phenomena....
. Occam's razor
Occam's razor

Occam's razor, also Ockham's razor, is a principle attributed to the 14th-century English logician and Franciscan friar, William of Ockham....
 also states the "principle of parsimony"; however, some argue that parsimony should not be elevated to the status of a general principle.

In systematics
Systematics

Biological systematics is the study of the diversification of life on the planet Earth, both past and present, and the relationships among living things through time....
, maximum parsimony
Maximum parsimony

Parsimony is a non-parametric statistics method commonly used in computational phylogenetics for estimating phylogeny. Under parsimony, the preferred phylogenetic tree is the tree that requires the least evolutionary change to explain some observed data....
 is a cladistic "optimality criterion" based on the principle of parsimony. Under maximum parsimony, the preferred phylogenetic tree
Phylogenetic tree

A phylogenetic tree or evolutionary tree is a tree showing the evolutionary relationships among various biological species or other entities that are believed to have a common descent....
 is the tree that requires the smallest number of evolutionary changes.

In biogeography
Biogeography

Biogeography is the study of the distribution of biodiversity over space and time. It aims to reveal where organisms live, and at what abundance....
, parsimony is used to infer ancient migration
Historical migration

It is theorized that pre-historical human migration began with the movement of Homo erectus out of Africa across Eurasia about a million years ago....
s of species
Species

In biology, a species is one of the basic units of biological classification and a taxonomic rank. A species is often defined as a group of organisms capable of interbreeding and producing fertile offspring....
 or population
Population

File:Population density.pngIn biology, a population is the collection of inter-breeding organisms of a particular species; in sociology, a collection of human beings....
s by observing the geographic distribution and relationships of existing organisms. Given the phylogenetic tree, ancestral migrations are inferred to be those that require the minimum amount of total movement.

Parsimony is also a factor in statistics
Statistics

Statistics is a Mathematics pertaining to the collection, analysis, interpretation or explanation, and presentation of data. It also provides tools for prediction and forecasting based on data....
: in general, mathematical models with the smallest number of parameter
Parameter

In mathematics, statistics, and the mathematical sciences, a parameter is a quantity that defines certain characteristics of systems or function s....
s are preferred as each parameter introduced into the model adds some uncertainty to it. Additionally, adding too many parameters leads to "connect-the-dots" curve-fitting which has little predictive power. In general terms, it may be said that applied statisticians (such as process control engineers) value parsimony quite highly.

Lee and others provide cases where a parsimonious approach does not guarantee a correct conclusion and, if based on incorrect working hypotheses or interpretations of incomplete data, may even strongly support a false conclusion:
When parsimony ceases to be a guideline and is instead elevated to an ex cathedra
Ex Cathedra

Ex Cathedra is a United Kingdom choir and early music musical ensemble based in Birmingham in the West Midlands , England. It performs choral music spanning the 15th to 21st centuries, and regularly commissions new works....
 pronouncement, parsimony analysis ceases to be science.


The scientific method

In science, parsimony is used as a heuristic
Heuristic

Heuristic is an adjective for methods that help in problem solving, in turn leading to learning and discovery. These methods in most cases employ experimentation and trial-and-error techniques....
 (rule of thumb) to guide scientists in the development of theoretical models rather than as an arbiter between published models. In physics
Physics

Physics is the natural science which examines basic concepts such as energy, force, and spacetime and all that derives from these, such as mass, charge, matter and its Motion ....
, parsimony
Parsimony

Parsimony is a 'less is better' concept of frugality, economy or caution in arriving at a hypothesis or course of action. The word derives from Middle English parcimony, from Latin parsimonia, from parsus, past participle of parcere: to spare....
 was an important heuristic
Heuristic

Heuristic is an adjective for methods that help in problem solving, in turn leading to learning and discovery. These methods in most cases employ experimentation and trial-and-error techniques....
 in the formulation of special relativity
Special relativity

Special relativity is the physical theory of measurement in inertial frames of reference proposed in 1905 by Albert Einstein in the paper "Annus Mirabilis Papers#Special relativity"....
 by Albert Einstein
Albert Einstein

Albert Einstein was a Germany-born theoretical physics. He is best known for his theory of relativity and specifically mass?energy equivalence, expressed by the equation E = mc2....
, the development and application of the principle of least action
Principle of least action

In physics, the principle of least action or more accurately principle of stationary action is a variational principle which, when applied to the action of a mechanics system, can be used to obtain the equations of motion for that system....
 by Pierre Louis Maupertuis
Pierre Louis Maupertuis

Pierre-Louis Moreau de Maupertuis was a France mathematician, philosopher and man of letters. He became the Director of the Acad?mie des Sciences, and the first President of the Berlin Academy of Science, at the invitation of Frederick the Great....
  and Leonhard Euler
Leonhard Euler

Leonhard Paul Euler was a pioneering Swiss mathematician and physicist who spent most of his life in Russia and Germany.Euler made important discoveries in fields as diverse as calculus and graph theory....
, and the development of quantum mechanics by Louis de Broglie, Richard Feynman
Richard Feynman

Richard Phillips Feynman was an United States physicist known for the path integral formulation of quantum mechanics, the theory of quantum electrodynamics and the physics of the superfluidity of supercooled liquid helium, as well as work in particle physics ....
, and Julian Schwinger
Julian Schwinger

Julian Seymour Schwinger was an United States theoretical physicist. He is best known for his work on the theory of quantum electrodynamics, in particular for developing a relativistically invariant perturbation theory, and for renormalizing QED to one loop order....
. In chemistry
Chemistry

Chemistry is the science concerned with the composition, structure, and properties of matter, as well as the changes it undergoes during chemical reactions....
, Occam’s razor is often an important heuristic
Heuristic

Heuristic is an adjective for methods that help in problem solving, in turn leading to learning and discovery. These methods in most cases employ experimentation and trial-and-error techniques....
 when developing a model of a reaction mechanism
Reaction mechanism

In chemistry, a reaction mechanism is the step by step sequence of elementary reactions by which overall chemical change occurs .Although only the net chemical change is directly observation for most chemical reactions, experiments can often be designed that suggest the possible sequence of steps in a reaction mechanism....
. However, while it is useful as a heuristic in developing models of reaction mechanisms, it has been shown to fail as a criteria for selecting among published models.

In the scientific method, Occam's razor, or parsimony
Parsimony

Parsimony is a 'less is better' concept of frugality, economy or caution in arriving at a hypothesis or course of action. The word derives from Middle English parcimony, from Latin parsimonia, from parsus, past participle of parcere: to spare....
, is an epistemological, metaphysical
Metaphysical

Metaphysical may refer to:*Metaphysics, a branch of philosophy dealing with aspects of the ultimate nature of reality*Metaphysical poets, a poetic school from seventeenth century England who correspond with baroque period in European literature...
, or heuristic
Heuristic

Heuristic is an adjective for methods that help in problem solving, in turn leading to learning and discovery. These methods in most cases employ experimentation and trial-and-error techniques....
 preference, not an irrefutable principle of logic
Logic

Logic is the study of the principles of valid demonstration and inference. Logic is a branch of philosophy, a part of the classical Trivium . The word derives from Greek language ?????? , fem....
, and certainly not a scientific result. As a logical principle, Occam's razor would demand that scientists accept the simplest possible theoretical explanation for existing data. However, science has shown repeatedly that future data often supports more complex theories than existing data. Science tends to prefer the simplest explanation that is consistent with the data available at a given time, but history shows that these simplest explanations often yield to complexities as new data becomes available.

When scientists use the idea of parsimony
Parsimony

Parsimony is a 'less is better' concept of frugality, economy or caution in arriving at a hypothesis or course of action. The word derives from Middle English parcimony, from Latin parsimonia, from parsus, past participle of parcere: to spare....
, it only has meaning in a very specific context of inquiry. A number of background assumptions are required for parsimony
Parsimony

Parsimony is a 'less is better' concept of frugality, economy or caution in arriving at a hypothesis or course of action. The word derives from Middle English parcimony, from Latin parsimonia, from parsus, past participle of parcere: to spare....
 to connect with plausibility in a particular research problem. The reasonableness of parsimony
Parsimony

Parsimony is a 'less is better' concept of frugality, economy or caution in arriving at a hypothesis or course of action. The word derives from Middle English parcimony, from Latin parsimonia, from parsus, past participle of parcere: to spare....
 in one research context may have nothing to do with its reasonableness in another. It is a mistake to think that there is a single global principle that spans diverse subject matter.

As a methodological principle, the demand for simplicity suggested by parsimony cannot be generally sustained. Parsimony cannot help toward a rational decision between competing explanations of the same empirical facts. One problem in formulating an explicit general principle is that complexity and simplicity are perspective notions whose meaning depends on the context of application and the user’s prior understanding. In the absence of an objective criteria for simplicity and complexity, parsimony itself does not support an objective epistemology
Epistemology

Epistemology or theory of knowledge is the branch of philosophy concerned with the nature and scope of knowledge. It addresses the questions:...
.

The problem of deciding between competing explanations for empirical facts cannot be solved by formal tools. Simplicity principles can be useful heuristics in formulating hypotheses, but they do not make a contribution to the selection of theories. A theory that is compatible with one person’s world view will be considered simple, clear, logical, and evident, whereas what is contrary to that world view will quickly be rejected as an overly complex explanation with senseless additional hypotheses. Parsimony, in this way, becomes a “mirror of prejudice.”

It has been suggested that parsimony is a widely accepted example of extraevidential consideration, even though it is entirely a metaphysical assumption. There is little empirical evidence that the world is actually simple or that simple accounts are more likely than complex ones to be true.

Most of the time, parsimony is a conservative tool, cutting out crazy, complicated constructions and assuring that hypotheses are grounded in the science of the day, thus yielding ‘normal’ science: models of explanation and prediction. There are, however, notable exceptions where Occam’s razor turns a conservative scientist into a reluctant revolutionary. For example, Max Planck
Max Planck

Karl Ernst Ludwig Marx Planck, better known as Max Planck was a Germany physicist. He is considered to be the founder of the Quantum mechanics, and one of the most important physicists of the twentieth century....
 interpolated between the Wein
Wein

Wein means grape, vine, wine in German language and Yiddish language.According to Nelly Weiss, Wein- style family names are originated from signboards like Jewish communities like Frankfurt/Main....
 and Jeans
Jeans

Jeans are pants, or trousers, made from denim. Mainly designed for work, they became popular among teenagers starting in the 1950s. Historic brands include Levi's and Wrangler Jeans....
 radiation laws used parsimony to formulate the quantum hypothesis, and even resisting tat hypothesis as it became more obvious that it was correct.

However, on many occasions parsimony has stifled or delayed scientific progress. For example, appeals to simplicity were used to deny the phenomena of meteorites, ball lightning, continental drift, and reverse transcriptase. It originally rejected DNA
DNA

Deoxyribonucleic acid is a nucleic acid that contains the genetics instructions used in the development and functioning of all known living organisms and some viruses....
 as the carrier of genetic information in favor of proteins, since proteins provided the simpler explanation. Likewise, at one time Occam's razor rejected the sun-centered model of the solar system in favor of the geocentric model, and it would have certainly viewed Kepler's or Newton's laws as unreasonably complicated had they been offered in Galileo's time. Theories that reach far beyond the available data are rare, but General Relativity
General relativity

General relativity or the general theory of relativity is the Geometry Theoretical physics of gravitation published by Albert Einstein in 1916....
 provides one example.

In hindsight, one can argue that it is simpler to consider DNA
DNA

Deoxyribonucleic acid is a nucleic acid that contains the genetics instructions used in the development and functioning of all known living organisms and some viruses....
 as the carrier of genetic information, because it uses a smaller number of building blocks (four nitrogenous bases). However, during the time that proteins were the favored genetic medium, it seemed like a more complex hypothesis to confer genetic information in DNA rather than proteins.

One can also argue (also in hindsight) for atomic building blocks for matter, because it provides a simpler explanation for the observed reversibility of both mixing and chemical reactions as simple separation and re-arrangements of the atomic building blocks. However, at the time, the atomic theory
Atomic theory

In chemistry and physics, atomic theory is a theory of the nature of matter, which states that matter is composed of discrete units called atoms, as opposed to the obsolete notion that matter could be divided into any arbitrarily small quantity....
 was considered more complex because it inferred the existence of invisible particles which had not been directly detected. The stronger form of Occam’s razor favored by Ernst Mach
Ernst Mach

Ernst Mach was an Austrians physicist and philosopher and is the namesake for the Mach number and the optical illusion known as Mach bands....
 gives rise to logical positivism
Logical positivism

Logical positivism is a school of philosophy that combines empiricism, the idea that observational evidence is indispensable for knowledge of the world, with a version of rationalism incorporating mathematical and logico-linguistic constructs and deductions in epistemology.See, e.g., : in Stanford Encyclopedia of Philosophy
 which rejects the atomic theory
Atomic theory

In chemistry and physics, atomic theory is a theory of the nature of matter, which states that matter is composed of discrete units called atoms, as opposed to the obsolete notion that matter could be divided into any arbitrarily small quantity....
 of John Dalton
John Dalton

John Dalton Fellow of the Royal Society was an England chemist, meteorologist and physicist. He is best known for his pioneering work in the development of modern atomic theory, and his research into Color blindness ....
 for over 100 years until the reality of atoms was more evident in Brownian motion
Brownian motion

Brownian motion is the seemingly random movement of particles suspended in a liquid or gas or the mathematical model used to describe such random movements, often called a particle theory....
, as explained by Albert Einstein
Albert Einstein

Albert Einstein was a Germany-born theoretical physics. He is best known for his theory of relativity and specifically mass?energy equivalence, expressed by the equation E = mc2....
.

In the same way, hindsight argues that postulating the aether
Aether

Aether originally was the personification of the "upper sky", space and heaven, in Greek mythology.The term aether, ?ther or ether may also refer to one of the following:...
 is more complex than transmission of light through a vacuum
Vacuum

A vacuum is a volume of space that is essentially empty of matter, such that its gaseous pressure is much less than atmospheric pressure. The word comes from the Latin term for "empty," but in reality, no volume of space can ever be perfectly empty....
. However, at the time, all known waves propagated through a physical medium, and it seemed simpler to postulate the existence of a medium rather than theorize about wave propagation without a medium. (Quantum electrodynamics
Quantum electrodynamics

Quantum electrodynamics is a relativity theory quantum field theory of electrodynamics. QED was developed by a number of physicists, beginning in the late 1920s....
 eventually showed that the vacuum is not complete nothingness, but it is something of a medium with which light and fundamental particles interact.) Likewise, Newton's idea of light particles seemed simpler than Young's idea of waves, so many clung to it.

Three axioms presupposed by the scientific method are realism (the existence of objective reality), the existence of observable natural laws, and the constancy of observable natural law. Rather than depend on provability of these axioms, science depends on the fact that they have not been objectively falsified. Occam’s razor and parsimony
Parsimony

Parsimony is a 'less is better' concept of frugality, economy or caution in arriving at a hypothesis or course of action. The word derives from Middle English parcimony, from Latin parsimonia, from parsus, past participle of parcere: to spare....
 support, but do not prove these general axioms of science. The general principle of science is that theories (or models) of natural law must be consistent with repeatable experimental observations. This ultimate arbiter (selection criterion) rests upon the axioms mentioned above.

There are many examples where Occam’s razor would have picked the wrong theory given the available data. Simplicity principles are useful philosophical preferences for choosing a more likely theory from among several possibilities that are each consistent with available data. However, anyone invoking Occam’s razor to support a model should be aware that additional data may well falsify the model currently favored by Occam’s razor. One accurate observation of a white crow falsifies the theory that “all crows are black.” Likewise, a single instance of Occam’s razor picking a wrong theory falsifies the razor as a general principle.

If multiple models of natural law make exactly the same testable predictions, they are equivalent and there is no need for parsimony to choose one that is preferred. For example, Newtonian, Hamiltonian, and Lagrangian classical mechanics are equivalent. Physicists have no interest in using Occam’s razor to say the other two are wrong. Likewise, there is no demand for simplicity principles arbitrate between wave and matrix formulations of quantum mechanics. Science often does not demand arbitration or selection criteria between models which make the same testable predictions.

Penal ethics

In penal theory and the philosophy of punishment, parsimony refers specifically to taking care in the distribution of punishment
Punishment

Punishment is the practice of imposing something suffering on a person or animal, usually in response to disobedient or morally wrong behavior....
 in order to avoid excessive punishment. In the utilitarian
Utilitarianism

Utilitarianism is the idea that the morality of an action is determined solely by its contribution to overall utility: that is, its contribution to happiness or pleasure as summed among all persons....
 approach to the philosophy of punishment, Jeremy Bentham
Jeremy Bentham

Jeremy Bentham was an England jurist, philosopher, and legal and social reformer. He was the brother of Samuel Bentham. He was a political radical, and a leading theorist in Anglo-American philosophy of law....
's "parsimony principle" states that any punishment greater than is required to achieve its end is unjust. The concept is related but not identical to the legal concept of proportionality
Proportionality (law)

Proportionality is a principle in law which although related covers two distinct concepts. Within municipal law it is used to convey the idea that the punishment of an offender should fit the crime....
. Parsimony is a key consideration of the modern restorative justice
Restorative justice

Restorative Justice is a theory of justice that focuses on crime and wrongdoing as acted against the individual or community rather than the state....
, and is a component of utilitarian approaches to punishment, as well as the prison abolition movement
Prison abolition movement

The prison abolition movement seeks to abolish prison and the prison system which advocates of the movement claim are inhumane. Prison abolitionists present a broad critique of the modern Western criminal justice system, alleged to be both racist and classist as well as ineffectual at reforming criminals, decreasing crime, or reconciling th...
. Bentham believed that true parsimony would require punishment to be individualised to take account of the sensibility
Sensibility

Sensibility refers to an acute perception of or responsiveness toward something, such as the emotions of another. This concept emerged in eighteenth-century Britain, and was closely associated with studies of sense perception as the means through which knowledge is gathered....
 of the individual – an individual more sensitive to punishment should be given a proportionately lesser one, since otherwise needless pain would be inflicted. Later utilitarian writers have tended to abandon this idea, in large part due to the impracticality of determining each alleged criminal's relative sensitivity to specific punishments.

See also

  • Occam's razor
    Occam's razor

    Occam's razor, also Ockham's razor, is a principle attributed to the 14th-century English logician and Franciscan friar, William of Ockham....
  • Maximum parsimony
    Maximum parsimony

    Parsimony is a non-parametric statistics method commonly used in computational phylogenetics for estimating phylogeny. Under parsimony, the preferred phylogenetic tree is the tree that requires the least evolutionary change to explain some observed data....
  • Cladistics
    Cladistics

    Cladistics is the hierarchical classification of species based on evolutionary ancestry. Cladistics is distinguished from other taxonomic systems because it focuses on evolution rather than similarities between species, and because it places heavy emphasis on objective, quantitative analysis....
  • KISS principle
    KISS principle

    The KISS principle states that design simplicity should be a key goal and that unnecessary complexity should be avoided.Related concepts...
  • Karl Popper
    Karl Popper

    Knight Bachelor Karl Raimund Popper Order of the Companions of Honour, Fellow of the Royal Society, Fellow of the British Academy was an Austrian and British philosopher and a professor at the London School of Economics....
  • Willi Hennig
    Willi Hennig

    Emil Hans Willi Hennig was a Germans biologist who is considered the founder of phylogenetic systematics, also known as cladistics. With his works on evolution and systematics he revolutionised the view of the natural order of beings....


External links