All Topics  
Canonical ensemble

 

   Email Print
   Bookmark   Link






 

Canonical ensemble



 
 
A canonical ensemble in statistical mechanics
Statistical mechanics

Statistical mechanics is the application of probability theory, which includes Mathematics tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force....
 is a statistical ensemble representing a probability distribution
Probability distribution

In probability theory and statistics, a probability distribution identifies either the probability of each value of an unidentified random variable , or the probability of the value falling within a particular interval ....
 of microscopic states of the system. The probability distribution is characterised by the proportion pi of members of the ensemble which exhibit a measurable macroscopic state i, where the proportion of microscopic states for each macroscopic state i is given by the Boltzmann distribution
Boltzmann distribution

In physics and mathematics, the Boltzmann distribution is a certain distribution function or probability measure for the distribution of the states of a system....
,

where Ei is the energy of state i.






Discussion
Ask a question about 'Canonical ensemble'
Start a new discussion about 'Canonical ensemble'
Answer questions from other users
Full Discussion Forum



Encyclopedia


A canonical ensemble in statistical mechanics
Statistical mechanics

Statistical mechanics is the application of probability theory, which includes Mathematics tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force....
 is a statistical ensemble representing a probability distribution
Probability distribution

In probability theory and statistics, a probability distribution identifies either the probability of each value of an unidentified random variable , or the probability of the value falling within a particular interval ....
 of microscopic states of the system. The probability distribution is characterised by the proportion pi of members of the ensemble which exhibit a measurable macroscopic state i, where the proportion of microscopic states for each macroscopic state i is given by the Boltzmann distribution
Boltzmann distribution

In physics and mathematics, the Boltzmann distribution is a certain distribution function or probability measure for the distribution of the states of a system....
,

where Ei is the energy of state i. It can be shown that this is the distribution which is most likely, if each system in the ensemble can exchange energy with a heat bath
Heat bath

A heat bath is a system whose heat capacity is so large that when it is in thermal contact with some other system of interest its temperature remains constant....
, or alternatively with a large number of similar systems. Equivalently, it is the distribution which has maximum entropy for a given average energy <Ei>.

It is also referred to as an NVT ensemble: the number of particles (N), the volume (V), of each system in the ensemble are the same, and the ensemble has a well defined temperature (T), given by the temperature of the heat bath with which it would be in equilibrium.

The quantity k is Boltzmann's constant, which relates the units of temperature to units of energy. It may be suppressed by expressing the absolute temperature using thermodynamic beta
Thermodynamic beta

In statistical mechanics, the thermodynamic beta is a numerical quantity related to the thermodynamic temperature of a system. The thermodynamic beta can be viewed as a connection between the statistical interpretation of a physical system and thermodynamics....
, .

The quantities A and Z are constants for a particular ensemble, which ensure that is normalised to 1. Z is therefore given by

.

This is called the partition function
Partition function (statistical mechanics)

In statistical mechanics, the partition function Z is an important quantity that encodes the statistics properties of a system in thermodynamic equilibrium....
 of the canonical ensemble. Specifying this dependence of Z on the energies Ei conveys the same mathematical information as specifying the form of pi above.

The canonical ensemble (and its partition function) is widely used as a tool to calculate thermodynamic quantites of a system under a fixed temperature. This article derives some basic elements of the canonical ensemble. Other related thermodynamic formulas are given in the partition function
Partition function (statistical mechanics)

In statistical mechanics, the partition function Z is an important quantity that encodes the statistics properties of a system in thermodynamic equilibrium....
 article. When viewed in a more general setting, the canonical ensemble is known as the Gibbs measure
Gibbs measure

In mathematics, the Gibbs measure, named after Josiah Willard Gibbs, is a probability measure frequently seen in many problems of probability theory and statistical mechanics....
, where, because it has the Markov property
Markov property

In mathematics, the term Markov property or Markov-type property can refer to either of two closely-related things.In the narrowest sense, a stochastic process has the Markov property if the conditional probability distribution of future states of the process, given the present state and a constant number of past states, depends...
 of statistical independence, it occurs in many settings outside of the field of physics.

Deriving the Boltzmann factor from ensemble theory


Let be the energy of the microstate
Microstate (statistical mechanics)

In statistical mechanics, a microstate describes a specific detailed microscopic configuration of a system, that the system visits in the course of its temperature....
  and suppose there are members of the ensemble residing in this state. Further we assume the total number of systems in the ensemble, , and the total energy of all systems of the ensemble, , are fixed, i.e.,

Since systems in the ensemble are distinguishable, for each set , the number of ways of shuffling systems is equal to

So for a given , there are rearrangements that specify the same state of the ensemble.

The most probable distribution is the one that maximizes . The probability for any other distribution to occur is extremely small in the limit . To determine this distribution, one should maximize with respect to the 's, under two constraints specified above. This can be done by using two Lagrange multipliers
Lagrange multipliers

In mathematical optimization , the method of Lagrange multipliers provides a strategy for finding the maximum/minimum of a function subject to constraint ....
  and . (The assumption that would be invoked in such calculation, which allows one to apply Stirling's approximation
Stirling's approximation

In mathematics, Stirling's approximation is an approximation for large factorials. It is named after James Stirling .The formula is written as...
.) The result is

.

This distribution is called the canonical distribution. To determine and , it is useful to introduce the partition function
Partition function

Partition function may refer to:*Partition function *Partition function , which generalizes its use in statistical mechanics and quantum field theory:...
 as a sum over microscopic states

Comparing with thermodynamic formulae, it can be shown that , is related to the absolute temperature as, . Moreover the expression

is identified as the Helmholtz free energy
Helmholtz free energy

In thermodynamics, the Helmholtz free energy is a thermodynamic potential which measures the ?useful? work obtainable from a closed system thermodynamic thermodynamic system at a constant temperature and volume....
 . A derivation is given here
Helmholtz free energy

In thermodynamics, the Helmholtz free energy is a thermodynamic potential which measures the ?useful? work obtainable from a closed system thermodynamic thermodynamic system at a constant temperature and volume....
. Consequently, from the partition function we can obtain the average thermodynamic quantities for the ensemble. For example, the average energy among members of the ensemble is

.

This relation can be used to determine . is determined from

.

A derivation from heat-bath viewpoint


Canonicalensemble
Define the following:

  • S - the system of interest
  • S' - the heat reservoir in which S resides; S is small compared to S'
  • S* - the system consisting of S and S' combined together
  • m - an indexing variable which labels all the available energy states of the system S
  • Em - the energy of the state corresponding to the index m for the system S
  • E' - the energy associated with the heat bath
  • E* - the energy associated with S*
  • O'(E) - denotes the number of microstates available at a particular energy E for the heat reservoir.


It is assumed that the system S and the reservoir S' are in thermal equilibrium. The objective is to calculate the set of probabilities pm that S is in a particular energy state Em.

Suppose S is in a microstate indexed by m. From the above definitions, the total energy of the system S* is given by

Notice E* is constant, since the combined system S* is taken to be isolated.

Now, arguably the key step in the derivation is that the probability of S being in the m-th state, , is proportional to the corresponding number of microstates available to the reservoir when S is in the m-th state. Therefore,

for some constant . Taking the logarithm gives

Since Em is small compared to E*, a Taylor series
Taylor series

In mathematics, the Taylor series is a representation of a function as an Series of terms calculated from the values of its derivatives at a single point....
 expansion can be performed on the latter logarithm around the energy E*. A good approximation can be obtained by keeping the first two terms of the Taylor series
Taylor series

In mathematics, the Taylor series is a representation of a function as an Series of terms calculated from the values of its derivatives at a single point....
 expansion:

The following quantity is a constant which is traditionally denoted by ß, known as the thermodynamic beta
Thermodynamic beta

In statistical mechanics, the thermodynamic beta is a numerical quantity related to the thermodynamic temperature of a system. The thermodynamic beta can be viewed as a connection between the statistical interpretation of a physical system and thermodynamics....
.

Finally,

Exponentiating this expression gives

The factor in front of the exponential can be treated as a normalization constant C, where

From this

Normalization to recover the partition function

Since probabilities must sum to 1, it must be the case that

where is known as the Partition function
Partition function (statistical mechanics)

In statistical mechanics, the partition function Z is an important quantity that encodes the statistics properties of a system in thermodynamic equilibrium....
 for the canonical ensemble.

Note on derivation

As mentioned above, the derivation hinges on recognizing that the probability of the system being in a particular state is proportional to the corresponding multiplicities of the reservoir (the same can be said for the grand canonical ensemble). As long as one makes that observation, it is flexible as how one might proceed. In the derivation given, the logarithm is taken, then a linear approximation based on physical arguments is used. Alternatively, one can apply the thermodynamic identity for differential entropy
Entropy

In many branches of science, entropy is a measure of the disorder of a system. The concept of entropy is particularly notable as it is applied across physics, information theory and mathematics....
:

and obtain the same result. See the article on Maxwell-Boltzmann statistics where this approach is employed.

The canonical ensemble is also called the Gibbs ensemble, in honor of J.W. Gibbs, widely regarded with Boltzmann as being one of the two fathers of statistical mechanics. In his definitive original book "Elementary Principles in Statistical Mechanics", Gibbs viewed an ensemble as a list of the allowed states of the system (each state appearing once and only once in the list) and the associated statistical weights. The states do not interact with each other, or with a reservoir, until Gibbs treats what happens when two complete ensembles at two different temperatures are allowed to interact weakly (Gibbs, pp 160). Gibbs writes that "...the distribution in phase..." (the phase space density in modern language) "...[is] called canonical...[if] the index of probability" (the logarithm of the statistical weight of the phase space density) "...is a linear function of the energy..." (Gibbs, Ch. 4). In Gibbs' formulation, this requirement (his equation 91, in modern notation

is taken to define the canonical ensemble and to be the fundamental postulate. Gibbs does show that a large collection of interacting microcanonical systems approaches the canonical ensemble, but this is part of his demonstration (Gibbs, pp 169-183) that the principle of equal a priori probabilities, therefore the microcanonical ensemble, are inferior to the canonical ensemble as an axiomatization of statistical mechanics, at every point where the two treatments differ.

Gibbs original formulation is still standard in modern mathematically rigorous treatments of statistical mechanics, where the canonical ensemble is defined as the probability measure with p and q being the canonical coordinates.

Characteristic state function

The characteristic state function
Characteristic state function

The characteristic state function in statistical mechanics refers to a particular relationship between the partition function of an ensemble....
 of the canonical ensemble is the Helmholtz free energy
Helmholtz free energy

In thermodynamics, the Helmholtz free energy is a thermodynamic potential which measures the ?useful? work obtainable from a closed system thermodynamic thermodynamic system at a constant temperature and volume....
 function, as the following relationship holds:

Quantum mechanical systems


By applying the canonical partition function, one can easily obtain the corresponding results for a canonical ensemble of quantum mechanical systems. A quantum mechanical ensemble in general is described by a density matrix
Density matrix

In quantum mechanics, a density matrix is a self-adjoint positive-semidefinite matrix, , of trace class one, that describes the statistical state of a quantum system....
. Suppose the Hamiltonian H of interest is a self adjoint operator with only discrete spectrum
Discrete spectrum

In physics, discrete spectrum is a finite set or a countable set of eigenvalues of an operator. An operator acting on a Hilbert space is said to have a discrete spectrum if its eigenvalues cannot be changed continuously....
. The energy levels are then the eigenvalues of H, corresponding to eigenvector . From the same considerations as in the classical case, the probability that a system from the ensemble will be in state is , for some constant . So the ensemble is described by the density matrix

(Technical note: a density matrix must be trace-class, therefore we have also assumed that the sequence of energy eigenvalues diverges sufficiently fast.) A density operator is assumed to have trace 1, so

which means

Q is the quantum-mechanical version of the canonical partition function. Putting C back into the equation for ? gives

By the assumption that the energy eigenvalues diverge, the Hamiltonian H is an unbounded operator, therefore we have invoked the Borel functional calculus
Borel functional calculus

In functional analysis, a branch of mathematics, the Borel functional calculus is a functional calculus , which has particularly broad scope....
 to exponentiate the Hamiltonian H. Alternatively, in non-rigorous fashion, one can consider that to be the exponential power series.

Notice the quantity

is the quantum mechanical counterpart of the canonical partition function, being the normalization factor for the mixed state of interest.

The density operator ? obtained above therefore describes the (mixed) state of a canonical ensemble of quantum mechanical systems. As with any density operator, if A is a physical observable, then its expected value is

Relations with other ensembles

A generalization of this is the grand canonical ensemble
Grand canonical ensemble

In statistical mechanics, the grand canonical ensemble is a statistical ensemble , where each system is in equilibrium with an external reservoir with respect to both particle and energy exchange....
, in which the systems may share particles as well as energy. By contrast, in the microcanonical ensemble
Microcanonical ensemble

The microcanonical ensemble is the simplest of the statistical ensemble of statistical mechanics....
, the energy of each individual system is fixed.

See also


External links