Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

2.1. Introduction to Statistical Mechanics

See also: Course-wide Conventions & Notation

Run the code: Notebook for Section 2.1, in which you can change and rerun the Python cells of this section in your browser.

The course map shows where this module sits in the course and which relations connect the microscopic and macroscopic descriptions. Select a module to unfold its sections.

Overview and Learning Objectives

Statistical mechanics bridges microscopic states and macroscopic thermodynamics by treating measurable quantities as ensemble averages. This section introduces expected values, defines the common ensembles (microcanonical, canonical, and grand canonical), and states the fundamental postulate for an isolated system.

Learning objectives:

Core Ideas and Derivations

Macroscopic Properties as Expected Values of Microscopic Properties

A core principle of statistical mechanics is that macroscopic thermodynamic properties are statistical averages (expected values) of microscopic properties.

Arithmetic Average vs. Expected Value

In basic statistics, the arithmetic average (sample mean) Xˉ\bar{X} of a dataset of nn values, X={X1,X2,…,Xn}X=\{X_1, X_2, \ldots, X_n\}, is:

Xˉ=1n∑j=1nXj.\bar{X} = \frac{1}{n} \sum_{j=1}^n X_j.

In statistical mechanics, we typically work with an expected value, which weights each outcome by its probability. For a discrete random variable XX that takes values {Xi}\{X_i\} with probabilities {pi}\{p_i\}, the expected value is

⟨X⟩=∑i=1MXi pi,\langle X \rangle = \sum_{i=1}^M X_i \, p_i,

where pip_i is the probability of the ii-th outcome (microstate), and the sum runs over the microstates included in the ensemble.

Table 2.1.1:Statistical Variables and Their Definitions

Symbol

Meaning

MM

Number of possible microstates (outcomes)

ii

Index of a microstate

XiX_i

Value of a microscopic property in microstate ii

⟨X⟩\langle X \rangle

Expected (ensemble) average of XX

pip_i

Probability of finding the system in microstate ii

In thermodynamics, typical choices of XX include the internal energy, enthalpy, or other measurable properties. We will compute such quantities by specifying the probabilities {pi}\{p_i\} appropriate to the ensemble of interest.

Ensembles of Microstates

Microstate
A complete specification of the microscopic state of a system: the positions and momenta of all particles in classical mechanics, or the quantum state of the system in quantum mechanics.
Macrostate
The thermodynamic state of a system, specified by a small number of macroscopic variables such as (N,V,E)\left(N, V, E\right). Many microstates are usually consistent with one macrostate.
Ensemble
The set of microstates consistent with specified macroscopic constraints. An ensemble can be pictured as a very large collection of copies of the system, each in one of these microstates; pip_i is then the fraction of copies in microstate ii.
Microcanonical ensemble
Microstates are sampled at fixed (N,V,E)\left(N, V, E\right).
Canonical ensemble
Microstates are sampled at fixed (N,V,T)\left(N, V, T\right).
Grand canonical ensemble
Microstates are sampled at fixed (μ,V,T)\left(\mu, V, T\right).

Figure 2.1.1 shows the system and its surroundings in each of the three ensembles.

Source
Loading...

Figure 2.1.1:The three ensembles. (a) Microcanonical ensemble: an isolated system, with NN, VV, and EE fixed. (b) Canonical ensemble: a closed system that exchanges energy with a heat bath at temperature TT, with NN, VV, and TT fixed. (c) Grand canonical ensemble: an open system that exchanges energy and matter with a reservoir at temperature TT and chemical potential μ\mu, with μ\mu, VV, and TT fixed.

Probability of a Microstate in the Microcanonical Ensemble

For an isolated system—one that exchanges neither energy nor matter with its surroundings—the appropriate statistical description is the microcanonical ensemble (panel (a) of Figure 2.1.1).

Fundamental Postulate of Statistical Mechanics

Therefore, the probability of finding the system in the ii-th microstate is

pi=1M,p_i = \frac{1}{M},

where MM is the total number of accessible microstates compatible with (N,V,E)\left(N, V, E\right).

Worked Example

Expected value vs. arithmetic mean (die rolls)

A fair die is rolled n=300n=300 times. Let Xj=1X_j=1 if the jj-th outcome is a six and Xj=0X_j=0 otherwise.

  1. One roll

    ⟨Xj⟩=1⋅16+0⋅56=16.\langle X_j\rangle = 1\cdot \frac{1}{6} + 0\cdot \frac{5}{6} = \frac{1}{6}.
  2. Linearity of expectation

    The expected total number of sixes is the sum of the individual expected values:

    ⟨Nsixes⟩=∑j=1300⟨Xj⟩=300(16)=50.\langle N_{\text{sixes}}\rangle = \sum_{j=1}^{300}\langle X_j\rangle = 300\left(\frac{1}{6}\right)=50.
  3. Arithmetic means from simulated rolls

    In five simulated sets of 300 rolls, the number of sixes was 56, 42, 49, 43, and 41. The arithmetic mean of XjX_j in each set, Xˉ=Nsixes/300\bar{X} = N_{\text{sixes}}/300, was therefore 0.187, 0.140, 0.163, 0.143, and 0.137, compared with ⟨Xj⟩=1/6≈0.167\langle X_j\rangle = 1/6 \approx 0.167.

Result. The expected number of sixes in 300 rolls is 50; the five simulated sets gave between 41 and 56.

Concept Checks

  1. In what sense is “temperature” absent from the microcanonical ensemble description?

  2. Why is the expected value ⟨X⟩\langle X\rangle more informative than the arithmetic mean of a single dataset when predicting thermodynamic properties?

  3. What physical meaning does “accessible microstate” carry in the fundamental postulate?

  4. How would you modify the probability assignment if only a subset of the nominal MM microstates were accessible?

Key Takeaways