All Topics  
Gibbs paradox

 

   Email Print
   Bookmark   Link






 

Gibbs paradox



 
 
Originally considered by Josiah Willard Gibbs
Josiah Willard Gibbs

Josiah Willard Gibbs was an American theoretical physicist, chemist, and mathematician. One of the greatest American scientists of all time, he devised much of the theoretical foundation for chemical thermodynamics as well as physical chemistry....
 in his paper On the Equilibrium of Heterogeneous Substances
On the Equilibrium of Heterogeneous Substances

In the history of thermodynamics, On the Equilibrium of Heterogeneous Substances is a 300-page paper written by American mathematical-engineer Willard Gibbs....
, the Gibbs paradox
Paradox

A paradox is a Proposition or group of statements that leads to a contradiction or a situation which defies intuition ; or, it can be an apparent contradiction that actually expresses a non-dual truth ....
 (Gibbs' paradox or Gibbs's paradox) applies to thermodynamics
Thermodynamics

In physics, thermodynamics is the study of the conversion of heat energy into different forms of energy ; different energy conversions into heat energy; and its relation to macroscopic variables such as temperature, pressure, and volume....
. It involves the discontinuous
Classification of discontinuities

Continuous functions are of utmost importance in mathematics and applications. However, not all function are continuous. If a function is not continuous at a point in its domain , one says that it has a discontinuity there....
 nature of the entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
. This discontinuous nature is paradoxical to the continuous nature of entropy itself with respect to equilibrium
Equilibrium

For the opposite, see disequilibrium.Equilibrium is the condition of a system in which competing influences are balanced and it may refer to:...
 and irreversibility
Irreversibility

In science, a process that is not reversible is called irreversible. This concept arises most frequently in thermodynamics, as applied to thermodynamic processes....
 in thermodynamic systems.

Suppose we have a box divided in half by a movable partition.






Discussion
Ask a question about 'Gibbs paradox'
Start a new discussion about 'Gibbs paradox'
Answer questions from other users
Full Discussion Forum



Encyclopedia


Willard Gibbs
Originally considered by Josiah Willard Gibbs
Josiah Willard Gibbs

Josiah Willard Gibbs was an American theoretical physicist, chemist, and mathematician. One of the greatest American scientists of all time, he devised much of the theoretical foundation for chemical thermodynamics as well as physical chemistry....
 in his paper On the Equilibrium of Heterogeneous Substances
On the Equilibrium of Heterogeneous Substances

In the history of thermodynamics, On the Equilibrium of Heterogeneous Substances is a 300-page paper written by American mathematical-engineer Willard Gibbs....
, the Gibbs paradox
Paradox

A paradox is a Proposition or group of statements that leads to a contradiction or a situation which defies intuition ; or, it can be an apparent contradiction that actually expresses a non-dual truth ....
 (Gibbs' paradox or Gibbs's paradox) applies to thermodynamics
Thermodynamics

In physics, thermodynamics is the study of the conversion of heat energy into different forms of energy ; different energy conversions into heat energy; and its relation to macroscopic variables such as temperature, pressure, and volume....
. It involves the discontinuous
Classification of discontinuities

Continuous functions are of utmost importance in mathematics and applications. However, not all function are continuous. If a function is not continuous at a point in its domain , one says that it has a discontinuity there....
 nature of the entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
. This discontinuous nature is paradoxical to the continuous nature of entropy itself with respect to equilibrium
Equilibrium

For the opposite, see disequilibrium.Equilibrium is the condition of a system in which competing influences are balanced and it may refer to:...
 and irreversibility
Irreversibility

In science, a process that is not reversible is called irreversible. This concept arises most frequently in thermodynamics, as applied to thermodynamic processes....
 in thermodynamic systems.

Suppose we have a box divided in half by a movable partition. On one side of the box is an ideal gas
Ideal gas

The ideal gas model is a model of matter in which the molecules are treated as non-interacting point particles which are engaged in a random motion that obeys conservation of energy....
 A, and on the other side is an ideal gas B at the same temperature
Temperature

In physics, temperature is a physical property of a Physical system that underlies the common notions of hot and cold; something that feels hotter generally has the greater temperature....
 and pressure
Pressure

Pressure is the force per unit area applied to an object in a direction surface normal to the surface. Gauge pressure is the pressure relative to the local atmospheric or ambient pressure....
. When the partition is removed, the two gases mix, and the entropy
Entropy

In many branches of science, entropy is a measure of the disorder of a system. The concept of entropy is particularly notable as it is applied across physics, information theory and mathematics....
 of the system increases because there is a larger degree of uncertainty in the position of the particles. It can be shown that the entropy of mixing multiplied by the temperature is equal to the amount of work one must do in order to restore the original conditions: gas A on one side, gas B on the other. If the gases are the same, no work is needed, but given a tiniest difference between the two, the work needed jumps to a large value, and furthermore it is the same value as when the difference between the two gases is great. Entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
 of liquids, solids and solutions can be calculated in a similar fashion and Gibbs paradox can be applied to liquids, solids and solutions in condensed phases as well as the gaseous phase.

Similarity and entropy of mixing

When Gibbs paradox is discussed, the correlation of the entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
 with similarity
Chemical similarity

Chemical similarity refers to the similarity of chemical elements, molecules or chemical compounds with respect to either chemical structure or functional qualities, i.e....
 is always very controversial and there are three very different opinions regarding the entropy value as related to the similarity (Figures a, b and c). Similarity may change continuously: similarity Z=0 if the components are distinguishable; similarity Z=1 if the parts are indistinguishable. Entropy of mixing does not change continuously in the Gibbs paradox.

There are many claimed resolutions and all of them fall into one of these three kinds of entropy of mixing-similarity relationship (Figures a, b and c).

A resolution corresponding to Figure (a) consists of accepting the discontinuity as fact, and stating that the common sense and intuitive objections to it are unfounded. This is the resolution given by Gibbs, and clarified by Jaynes
Edwin Thompson Jaynes

Edwin Thompson Jaynes was Wayman Crow Distinguished Professor of Physics at Washington University in St. Louis, Missouri. He wrote extensively on statistical mechanics and on foundations of probability and statistical inference, initiating in 1957 the Maximum entropy thermodynamics of thermodynamics, as being a particular application of mor...
.

John von Neumann provided an alternative resolution of the Gibbs paradox by removing the discontinuity of the entropy of mixing: it decreases continuously with the increase in the property similarity of the individual components (See Figure b). More recently Shu-Kun Lin provided still another relationship (See Figure c). They will be explained in detail in a following section.

Entropy discontinuity


Classical explanation in thermodynamics

Gibbs himself posed a solution to the problem which many scientists take as Gibbs's own resolution of the Gibbs paradox. The crux of his resolution is the fact that if one develops a classical theory based on the idea that the two different types of gas are indistinguishable, and one never carries out any measurement which reveals the difference, then the theory will have no internal inconsistencies. In other words, if we have two gases A and B and we have not yet discovered that they are different, then assuming they are the same will cause us no theoretical problems. If ever we perform an experiment with these gases that yields incorrect results, we will certainly have discovered a method of detecting their difference.

This insight suggests that the concept of thermodynamic state and entropy are somewhat subjective. The increase in entropy as a result of mixing multiplied by the temperature is equal to the minimum amount of work we must do to restore the gases to their original separated state. Suppose that the two different gases are separated by a partition, but that we cannot detect the difference between them. We remove the partition. How much work does it take to restore the original thermodynamic state? None — simply reinsert the partition. (Of course, some work has to be done to remove the partition, but that work is mechanical work. Here we say no work is being done because in Thermodynamics, we consider only the "thermodynamic" work.) The fact that the different gases have mixed does not yield a detectable change in the state of the gas, if by state we mean a unique set of values for all parameters that we have available to us to distinguish states. The minute we become able to distinguish the difference, at that moment the amount of work necessary to recover the original macroscopic configuration becomes non-zero, and the amount of work does not depend on the magnitude of the difference.

The mixing of the gases can be done in a reversible way by use of semipermeable walls. The semipermeable walls experience a pressure and so mixing extracts mechanical energy and the temperature lowers. If the gases are identical there exist no semipermeable walls and so there is no way to extract mechanical energy by mixing.

Many authors maintain the opinion that paradox is resolved by arguing that the discontinuity is real.

Explanation in statistical mechanics and quantum mechanics, N! and entropy extensivity

A large number of scientists believe that this paradox is resolved in statistical mechanics
Statistical mechanics

Statistical mechanics is the application of probability theory, which includes Mathematics tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force....
 (attributed also to Gibbs) or in quantum mechanics by realizing that if the two gases are composed of indistinguishable particles
Identical particles

Identical particles, or indistinguishable particles, are particles that cannot be distinguished from one another, even in principle. Species of identical particles include elementary particles such as electrons, as well as composite microscopic particles such as atoms and molecules....
, they obey different statistics than if they are distinguishable. Since the distinction between the particles is discontinuous, so is the entropy of mixing. The resulting equation for the entropy of a classical ideal gas
Ideal gas

The ideal gas model is a model of matter in which the molecules are treated as non-interacting point particles which are engaged in a random motion that obeys conservation of energy....
 is extensive, and is known as the Sackur-Tetrode equation
Sackur-Tetrode equation

The Sackur?Tetrode equation is an expression for the entropy of a monatomicclassical ideal gas which uses quantum considerations to arriveat an exact formula....
. If this equation is used, the entropy value will have no difference after mixing two parts of the identical gases. In this context, entropy extensivity, particle indistinguishability and introduction of a term

into the entropy formula (Sackur-Tetrode equation
Sackur-Tetrode equation

The Sackur?Tetrode equation is an expression for the entropy of a monatomicclassical ideal gas which uses quantum considerations to arriveat an exact formula....
) are usually discussed. See also:

Entropy continuity


Johnvonneumann Losalamos
Whereas many scientists feel comfortable with the entropy discontinuity shown in Figure (a) and satisfied with the classical or the quantum mechanical explanations in thermodynamics or in statistical mechanics, other people admit that Gibbs paradox is a real paradox which should be resolved by showing entropy continuity.

A quantum mechanics resolution of Gibbs paradox


Few scientists have attempted to prove that entropy of mixing is actually continuous. In his book Mathematical Foundations of Quantum Mechanics, John von Neumann
John von Neumann

John von Neumann was a Hungarian American mathematician who made major contributions to a vast range of fields, including set theory, functional analysis, quantum mechanics, ergodic theory, continuous geometry, economics and game theory, computer science, numerical analysis, hydrodynamics , and statistics, as well as many other mathematical...
 provided, for the first time, a resolution to the Gibbs paradox by removing the discontinuity
Classification of discontinuities

Continuous functions are of utmost importance in mathematics and applications. However, not all function are continuous. If a function is not continuous at a point in its domain , one says that it has a discontinuity there....
 of the entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
: it decreases continuously
Continuous function

In mathematics, a continuous function is a function for which, intuitively, small changes in the input result in small changes in the output. Otherwise, a function is said to be discontinuous....
 with the increase in the property similarity of the individual components (See Figure b).

On page 370 of the English version of this book, it reads that " ... This clarifies an old paradox of the classical form of thermodynamics, namely the uncomfortable discontinuity in the operation with semi-permeable walls... We now have a continuous transition."

A few scientists agree with this resolution, others are still not convinced.

An information theory resolution of Gibbs paradox


Another entropy continuity relation has been proposed by Shu-Kun Lin based on information theory consideration, as shown in Figure (c). A calorimeter
Calorimeter

| |}A calorimeter is a device used for calorimetry, the science of measuring the heat of chemical reactions or physical changes as well as heat capacity....
 might be employed to determine the entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
 and to either verify the proposition of Gibbs paradox or to resolve the Gibbs paradox. Unfortunately it is well-known that none of the typical mixing processes have a detectable amount of heat
Heat

In physics and thermodynamics, heat is any transfer of energy from one body or thermodynamic system to another due to a difference in temperature....
 and work
Work (thermodynamics)

In thermodynamics, work is the quantity of energy transferred from one system to another without an accompanying transfer of entropy. It is a generalization of the concept of mechanical work in mechanics....
 transferred, even though a large amount of heat, up to the value calculated as T?S (where T is temperature and S is thermodynamic entropy), should have been measured and a large amount of work up to the amount calculated as ?G (where G is the Gibbs free energy
Gibbs free energy

In thermodynamics, the Gibbs free energy is a thermodynamic potential that measures the "useful" or process-initiating Work obtainable from an isothermal, Isobaric process thermodynamic system....
) should have been observed. We may have to, rather reluctantly, accept the simple fact that the (thermodynamic) entropy
Entropy

In many branches of science, entropy is a measure of the disorder of a system. The concept of entropy is particularly notable as it is applied across physics, information theory and mathematics....
 change of mixing of ideal gases is always zero
, whether the gases are different or identical. This may suggest that entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
 has nothing to do with energy (heat T?S or work ?G). A mixing process may be a process of information loss which can be pertinently discussed only in the realm of information theory
Information theory

Information theory is a branch of applied mathematics and electrical engineering involving the quantification of information. Historically, information theory was developed by Claude E....
 and entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
 is an (information theory) entropy
Information entropy

In information theory, entropy is a measure of the uncertainty associated with a random variable. The term by itself in this context usually refers to the Shannon entropy, which quantifies, in the sense of an expected value, the self-information contained in a message, usually in units such as bits....
. Instead of calorimeters, chemical sensors
Sensor

A sensor is a device that measures a physical quantity and converts it into a signal which can be read by an observer or by an instrument. For example, a mercury thermometer converts the measured temperature into expansion and contraction of a liquid which can be read on a calibrated glass tube....
 or biosensors
Sensor

A sensor is a device that measures a physical quantity and converts it into a signal which can be read by an observer or by an instrument. For example, a mercury thermometer converts the measured temperature into expansion and contraction of a liquid which can be read on a calibrated glass tube....
 can be used to assess the information loss during the mixing process. Mixing 1 mole
Mole (unit)

The mole is a Units of measurement of amount of substance: it is an SI base unit, and one of the few units used to measure this physical quantity....
 of gas A and 1 mole of a different gas B will have the increase of at most 2 bits of (information theory) entropy
Information entropy

In information theory, entropy is a measure of the uncertainty associated with a random variable. The term by itself in this context usually refers to the Shannon entropy, which quantifies, in the sense of an expected value, the self-information contained in a message, usually in units such as bits....
 if the two parts of the gas container are used to record 2 bits of information.

For condensed phases, instead of the word "mixing", the word "merging" can be used for the process of combining several parts of substance originally in several containers. Then, it is always a merging process, whether the substances are very different or very similar or even the same. Conventional way of entropy of mixing
Entropy of mixing

The entropy of mixing is the change in the configuration entropy, an extensive quantity thermodynamics quantity, when two different chemical substances or components are mixed....
 calculation would predict that the mixing (or merging) process of different (distinguishable) substances is more spontaneous than the merging process of the same (indistinguishable) substances. However, this contradicts all the observed facts in the physical world where the merging process of the same (indistinguishable) substances is the most spontaneous one; immediate examples are spontaneous merging of oil droplets in water and spontaneous crystallization where the indistinguishable unit lattice cells assemble together. More similar substances are more spontaneously miscible. The two liquids methanol and ethanol are miscible because they are very similar. Without exception, all the experimental observations support the entropy-similarity relation given in Figure (c). It follows that the entropy–similarity relation of Gibbs paradox given in Figure (a) is questionable. A significant conclusion is that, at least in the solid state, the entropy of mixing is a negative value for distinguishable solids: mixing different substances will decrease the (information theory) entropy, and the merging of the indistinguishable molecules (from a large number of containers) to form a phase
Phase (matter)

In the physical sciences, a phase is a region of space , throughout which all physical properties of a material are essentially uniform. Examples of physical properties include density, refractive index, and chemical composition....
 of pure substance has a great increase in (information theory) entropy. Starting from a binary solid mixture, the process of merging 1 mole of molecules A to become one phase and merging of 1 mole of molecules B to form another phase leads to an (information theory) entropy increase of 2×6.022=12.044bits=1.506Bytes, where 6.022 is the Avogadro's number; and there will be at most only 2 bits of information left.

External links

  • — a list of publications.
  • published in the Open Access journal Entropy
    Entropy (journal)

    Entropy , an International and Interdisciplinary Journal of Entropy and Information Studies, is published by MDPI in Basel, Switzerland, and is a peer-reviewed Open Access journal....
    .