This preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full Document
Unformatted text preview: CHAPTER III
STATISTICAL MECHANICS Thermodynamics is a simple, general, logical science, based on two
postulates, the ﬁrst and second laws of thermodynamics. We have seen
in the last chapter how to derive results from these laws, though we have
not used them yet in our applications. But we have seen that they are
limited. Typical results are like Eq. (5.2) in Chap. 11, giving the differ
ence of speciﬁc heats of any substance, 0? — Cy, in terms of derivatives
which can .be found from the equation of state. Thermodynamics can
give relations, but it cannot derive the speciﬁc heat or equation of state
directly. To do that, we must go to the statistical or kinetic methods.
Even the second law is simply a postulate, veriﬁed because it leads to
correct results, but not derived from simpler mechanical principles as far
as thermodynamics is concerned. We shall now take up the statistical
method, showing how it can lead not only to the equation of state and
speciﬁc heat, but to an understanding of the second law as well. 1. Statistical Assemblies and the Entropy.——To apply statistics to
any problem, we must have a great many individuals whose average
properties we are interested in. We may ask, what are the individuals to
which we apply statistics, in statistical mechanics? The answer is, they
are a great many repetitions of the same experiment, or replicas of the
same system, identical as far as all largescale, or macroscopic, properties
are concerned, but differing in the smallscale, or microscopic, properties
which we cannot directly observe. A collection of such replicas of the
same system is called a statistical assembly (or, following Gibbs, an
ensemble). Our guiding principle in setting up an assembly is to arrange
it so that the fluctuation of microscopic properties from one system to
another of the assembly agrees with the amount of such ﬂuctuation which
would actually occur from one repetition to another of the same
experiment. Let us ask what the randomness that we associated with entropy in
Chap. I means in terms of the assembly. A random system, or one of
large entropy, is one in which the microscopic properties may be arranged
in a great many different ways, all consistent with the same large—scale
behavior. Many different assignments of velocity to individual mole—
cules, for instance, can be consistent with the picture of a gas at high
temperatures, while in contrast the assignment of velocity to molecules at the absolute zero is deﬁnitely ﬁxed: all the molecules are at rest. Then
32 SEC. 1] STATISTICAL MECHANICS 33 to represent a random state we must have an assembly which is dis
tributed over many microscopic states, the randomness being measured
by the Wideness of the distribution. We can make this idea more precise.
Following Planck, we may refer to a particular microscopic state of the
system as a complexion. We may describe an assembly by stating what
fraction of the systems of the assembly is found in each possible com
plexion. We shall call this fraction, for the ith complexion, f.~, and shall
refer to the set of fi’s as the distribution function describing the assembly.
Plainly, since all systems must be in one complexion or another, 2f. = 1. (1.1) Then in a random assembly, describing a system of large entropy, there
will be systems of the assembly distributed over a great many complex—
ions, so that many f.’s will be different from zero, each one of these frac—
tions being necessarily small. 011 the other hand, in an assembly of low
entropy, systems will be distributed over only a small number of com
plexions, so that only a few fg’s Will be different from zero, and these will
be comparatively large. We shall now postulate a mathematical deﬁnition of entropy, in terms
of the fi’s, which is large in the case of a random distribution, small other
wise. This deﬁnition is s = —k2f.1nf.~. (1.2) Here 10 is a constant, called Boltzmann’s constant, which will appear fre
quently in our statistical work. It has the same dimensions as entropy,
or speciﬁc heat, that is, energy divided by temperature. Its value in
absolute units is 1.379 X 10”16 erg per degree. This value is derived
indirectly; using Eq. (1.2), for the entropy, one can derive the perfect
gas law and the gas constant, in terms of 19, thereby determining 10 from
experiment. It is easy to see that Eq. (1.2) has the required property of being
large for a randomly arranged system, small for one with no randomness.
If there is no randomness at all, all values of f. will be zero, except one,
which will be unity. But the functionflnfis zero whenfis either zero or
unity, so that the entropy in this case will be zero, its lowest possible
value. On the other hand, if the system is a random one, many com
plexions will have f. diﬁerent from zero, equal to small fractions, so that
their logarithms will be large negative quantities, and the entropy will be
large and positive. We can see this more clearly if we take a simple
case: suppose the assembly is distributed through W complexions, with 34 INTRODUCTION TO CHEMICAL PHYSICS [CHAR III equal fractions in each. The value of each f. in these complexions is
1 / W, While for other complexions f, is zero. Then we have 1 1
= k ln W. (1.3) The entropy, in such a case, is proportional to the logarithm of the number
of complexions in which systems of the assembly can be found. As this
number of complexions increases, the distribution becomes more random
or diffuse, and the entropy inereases. Boltzmannl based his theory of the relation of probability to entropy
on Eq. (1.3), rather than using the more general relation (1.2). He called
W the thermodynamic probability of a state, arguing much as we have
that a random state, which is inherently likely to be realized, will have a
large value of W. Planck2 has shown by the following simple argument
that the logarithmic form of Eq. (1.3) is reasonable. Suppose the system
consists of two parts, as for instance two different masses of gas, not con—
nected with each other. In a given state, represented by a given assem—
bly, let there be W 1 complexions of the ﬁrst part of the system consistent
with the macroscopic description of the state, and W2 complexions of the
second part. Then, since the two parts of the system are independent of
each other, there must be Wle complexions of the combined system,
since each complexion of the ﬁrst part can be joined to any one of the
complexions of the second part to give a complexion of the combined
system. We shall then ﬁnd for the entropy of the combined system S = k In W1W2
= k in W1 + k in W2. But if we considered the ﬁrst part of the system by itself, it would have
an entropy S; = k In W1, and the second part by itself would have an
entropy 32 = k In W2. Thus, on account of the relation (1.3), we have S = S1 + 32. (15) But surely this relation must be true; in thermodynamics, the entropy
of two separated systems is the sum of the entropies of the parts, as we
can see directly from the second law, sinee the ehanges of entropy, dQ/ T,
in a reversible process, are additive. Then we can reverse the argument
above. Equation (1.5) must be true, and if the entropy is a function of
W, it can be shown that the only possible function consistent with the
additivity of the entropy is the logarithmic function of Eq. (1.3). ‘ See for example, L. Boltzmann, “Vorlesungen fiber Gastheorie,” Sec. 6, J. A.
Barth. ’ See for example, M. Planck, “Heat Radiation,” Sec. 119, P. Blakiston’s Sons &
Company. SEC. 1] STATISTICAL MECHANICS 35 Going back to our more general formula (1.2), we can show that if
the assembly is distributed through W complexions, the entropy will have
its maximum value when the f;’s are of equal magnitude, and is reduced
by any ﬂuctuation in f, from cell to cell, verifying that any concentration
of systems in particular complexions reduces the entropy. Taking the
formula (1.2) for entropy, we ﬁnd how it ehanges when the fg’s are varied.
Differentiating, we have at once d8 = ~k2(1 + 1n j.)df.. (1.6) But we know from Eq. (1.1) that 2f. = 1, from which at once 2d]. = 0. (1.7) Thus the ﬁrst term of Eq. (1.6) vanishes; and if we assume that the
density is uniform, so that 111 f, is really independent of j}, we can take it
out of the summation in Eq. (1.6) as a common faetor, and the remaining
term will vanish too, giving (15' = 0. That is, for uniform density, the
variation of the entropy for small variations of the assembly vanishes, a
neeessary condition for a maximum of the entropy. A little further
investigation would convince us that this really gives a maximum, not a
minimum, of entropy, and that in fact Eq. (1.3) gives the absolute maxi
mum, the highest value of which S is capable, so long as only W complex
ions are represented in the assembly. The only way to get a still greater
value of S would be to have more terms in the summation, so that each
individual f, could be even less. We have postulated a formula for the entropy. How can we expect
to prove that it is correct? We can do this only by going back to the
second law of thermodynamics, showing that our entropy has the prop—
erties demanded by that law, and that in terms of it the law is satisﬁed.
We have already shown that our formula for the entropy has one of the
properties demanded of the entropy: it is determined by the state of the
system. In statistical mechanics, the only thing we ean mean by the
state of the system is the statistical assembly, since this determines
average or observable properties of all sorts, and our formula (1.2) for
entropy is determined by the statistical assembly. Next we must show
that our formula represents a quantity that increases in an irreversible
process. This will be done by qualitative but valid reasoning in a later
section. It will then remain to consider thermal equilibrium and reversi—
ble processes, and to show that in such processes the change of entropy is dQ/T. 36 INTROD UCTION T0 CHEMICAL PHYSICS [CHAR III 2. Complexions and the Phase Space.—We wish to ﬁnd how our
formula for the entropy changes in an irreversible process. To do this,
we must ﬁnd how the fi’s change with time, or how systems of the assem
bly, as time goes on, change from one complexion to another. This is a
problem in kinetics, and we shall not take it up quantitatively until the
chapter on kinetic methods. For the present we shall be content with
qualitative discussions. The ﬁrst thing that we must do is to get a more
precise deﬁnition of a complexion. We have a certain amount of informa—
tion to guide us in making this deﬁnition. We are trying to make our
deﬁnition of entropy agree with experience, and in particular we want the
state of maximum entropy to be the stable, equilibrium state. But we
have just seen that for an assembly distributed through W complexions,
the state of maximum entropy is that in which equal numbers of systems
are found in each complexion. This is commonly expressed by saying
that complexions have equal a priori probability; that is, if we have no
speciﬁc information to the contrary, we are as likely to ﬁnd a system of an
assembly in one complexion as in another, in equilibrium. Our deﬁnition
of a complexion, then, must be consistent with this situation. The method of deﬁning complexions depends on whether we are treat—
ing our systems by classical, Newtonian mechanics or by quantum theory.
First we shall take up classical mechanics, for that is more familiar. But
later, when we describe the methods of quantum theory, we shall observe
that that theory is more correct and more fundamental for statistical
purposes. In classical mechanics, a system is described by giving the
coordinates and velocities of all its particles. Instead of the velocities,
it proves to be more desirable to use the momenta. With rectangular
coordinates, the momentum associated with each coordinate is simply the
mass of the particle times the corresponding component of velocity; with
angular coordinates a momentum is an angular momentum; and so on. If
there are N coordinates and N momenta (as for instance the rectangular
coordinates of N /3 particles, with their momenta), we can then visualize
the situation by setting up a 2N dimensional space, called a phase space,
in which the coordinates and momenta are plotted as variables, and a
single point, called a representative point, gives complete information
about the system. An assembly of systems corresponds to a collection of
representative points, and we shall generally assume that there are so
many systems in the assembly that the distribution of representative
points is practically continuous in the phase space. Now a complexion,
or microscopic state, of the system must correspond to a particular point,
or small region, of the phase space; to be more precise, it should corre
spond to a small volume of the phase space. We subdivide the whole
phase space into small volume elements and call each volume element a
complexion, saying that f,, the fraction of systems of the assembly in a SEC. 2] STATISTICAL MECHANICS 37 particular complexion, simply equals the fraction of all representative
points in the corresponding volume element. The only question that
alises, then, is the shape and size of volume elements representing
complexions. To answer this question, we must consider how points move in the
phase space. We must know the time rates of change of all coordinates
and momenta, in terms of the coordinates and momenta themselves.
Newton’s second law gives us the time rate of change of each momentum,
stating that it equals the corresponding component of force, which is a
function of the coordinates in a conservative system. The time rate of
change of each coordinate is simply the corresponding velocity com—
ponent, which can be found at once from the momentum. Thus we can
ﬁnd what is essentially the 2N dimensional velocity vector of each repre—
sentative point. This velocity vector is determined at each point of
phase space and deﬁnes a rate of ﬂow, the representative points streaming
through the phase space as a ﬂuid would stream through ordinary space.
We are thus in a position to ﬁnd how many points enter or leave each
element of volume, or each complexion, per unit time, and therefore to
ﬁnd the rate at which the fraction of systems in that complexion changes
with time. It is now easy to prove, from the equations of motion, a
general theorem called Liouville’s theorem.I This theorem states, in
mathematical language, the following fact: the swarm of points moves in
such a way that the density of points, as we follow along with the swarm,
never changes. The flow is like a streamline ﬂow of an incompressible
ﬂuid, each particle of ﬂuid always preserving its own density. This does
not mean that the density at a given point of space does not change with
time; in general it does, for in the course of the ﬂow, ﬁrst a dense part of
the swarm, then a less dense one, may well be swept by the point in
question, as if we had an incompressible ﬂuid, but one whose density
changed from point to point. It does mean, however, that we can ﬁnd a
very simple condition which is necessary and sufﬁcient for the density
at a given point of space to be independent of time: the density of points
must be constant all along each streamline, or tube of ﬂow, of the points.
For then, no matter how long the ﬂow continues, the portions of the
swarm successively brought up to the point in question all have the same
density, so that the density there can never change. To ﬁnd the condition for equilibrium, then, we must investigate
the nature of the streamlines. For a periodic motion, a streamline will be
closed, the system returning to its original state after a single period.
This is a very special case, however; most motions of many particles are
not periodic and their streamlines never close. Rather, they wind around 1For proof, see for example, Slater and Frank, “Introduction to Theoretical
Physics,” pp. 365366, MeGrawHill Book Company, Inc., 1933. 38 INTRODUCTION TO CHEMICAL PHYSICS [CHAR III in a very complicated way, coming in the course of time arbitrarily close
to every point of phase space corresponding to the same total energy (of
course the energy cannot change with time, so that the representative
point must stay in a region of constant energy in the phase space). Such
a motion is called quasi—ergodic, and it can be shown to be the general
type of motion, periodic motions being a rare exception. Then, from the
statement in the last paragraph, we see that to have a distribution inde—
pendent of time, we must have a density of points in phase space which
is constant for all regions of the same energy. But on the other hand
thermal equilibrium must correspond to a distribution independent of
time, and we have seen that the state of maximum entropy is one in which
all complexions have the same number of systems. These two state
ments are only compatible if each complexion corresponds to the same
volume of phase space. For then a constant volume density of points,
which by Liouville’s theorem corresponds to a distribution independent
of time, will at the same time correspond to a maximum entropy. We
thus draw the important conclusion that regions of equal volume in phase
space have equal a priori probability, or that a complexion corresponds
to a quite deﬁnite volume of phase space. Classical mechanics, however,
does not lead to any way of saying how large this volume is. Thus it
cannot lead to any unique deﬁnition of the entropy; for the fi’s depend on
how large a volume each complexion corresponds to, and they in turn
determine the entropy. 3. Cells in the Phase Space and the Quantum Theory.———Quantum
mechanics starts out quite differently from classical mechanics. It does
not undertake to say how the coordinates and momenta of the particles
change as time goes on. Rather, it is a statistical theory from the begin—
ning: it sets up a statistical assembly, and tells us directly how that
assembly changes with time, without the intermediate step of solving for
the motion of individual systems by Newton’s laws of motion. And it
describes the assembly, from the outset, in terms of deﬁnite complexions,
so that the problem of deﬁning the complexions is answered as one of the
postulates of the theory. It sets up quantum states, of equal a priori
probability, and describes an assembly by giving the fraction of all sys—
tems in each quantum state. Instead of giving laws of motion, like
Newton’s second law, its fundamental equation is one telling how many
systems enter or leave each quantum state per second. In particular, if
equal fractions of the systems are found in all quantum states associated
with the same energy, we learn that these fractions will not change with
time; that is, in a steady or equilibrium state all the quantum states are
equally occupied, or have equal a priori probabilities. We are then
entirely justiﬁed in identifying these quantum states with the complex—
ions which we have mentioned. When we deal with quantum statistics, SEC. 3] STATISTICAL MECHANICS 39 I. will refer to the fraction of all systems in the ith quantum state. This
gives a deﬁnite meaning to the complexions, and leads to a deﬁnite numer
ical value for the entropy. Quantum theory provides no unique way of setting up the quantum
states, or the eomplexions. lVe can understand this much better by
considering the phase space. Many features of the quantum theory can
be described by dividing the phase space into cells of equal volume, and
associating each cell with a quantum state. The volume of these cells is
uniquely ﬁxed by the quantum theory, but not their shape. We can, for
example, take Simply rectangular cells, of dimensions Aql along the axis
representing the ﬁrst coordinate, AQ2 for the second coordinate, and so on
up to A9” for the Nth coordinate, and Ap, to ApN for the corresponding momenta. Then there is a very simple rule giving the volume of such a
cell: we have Ainp,‘ = h, where h is Planck’s constant, equal numerically to 6.61 X 10”27 absolute
units. Thus, with N coordinates, the 2N—dimensional volume of a cell
is h". We can equally well take other shapes of cells. A method which is
often useful can be illustrated with a problem having but one coordinate q
and one momentum p. Then in our twodimensional phase space we can
draw a curve of constant energy. Thus for instance consider a particle
of mass m held to a position of equilibrium by a restoring force propor—
tional to the displacement, so that its energy is p2
E = '2?" 2r2mv2q2, Where V is the frequency with which it would oscillate in classical mechanics. The curves of constant energy are then ellipses in the p—q
space, as we see by writing the equation in the form 2 P g2 _
(x/mr + WW2 1’ (33) the standard form for the equation of an ellipse of semiaxes \/2mE’ and \/E/27rzmvz. Such an ellipse is shown in Fig. III—1. Then we can choose
cells bounded by such curves of constant energy, such as those indicated
in Fig. III1. Since the area between curves must be h, it is plain that the
nth ellipse must have an area 7172, where n is an integer. The area of an
ellipse of semiaxes a and b is 1rab ; thus in this case we have an area of 1r\/27nE\/E/21r2m112 = E/v, so that the energy of the ellipse connected 40 INTRODUCTION TO CHEItIIC’AL PHYSICS [CHAR III with a given integer n is given by
E, = nhv. (3.4)
Another illustration of this method is provided by a freely rotating wheel of moment of inertia I. The natural coordinate to use to describe it is
the angle 6, and the corresponding momentum pg is the angular momen— FIG. IIIL—Cells in phase space, for the linear osaillator. The shaded area, between
two ellipses of constant energy, has an area h in the quantum theory. turn, I m, where w = dﬂ/dt is the angular velocity. If no torques act, the
energy is wholly kinetic, equal to « = gm = pea/21. (3.5) Then, as shown in Fig. III—2, lines of constant energy are straight lines at constant value of pa. Since 0 goes from zero to 27r, and then the motion
repeats, we use only values of the coordinate in this range. Then, if the cells are set up so
that the area of each is h, we must have them bounded by the lines nh
= —’ 3.6
Pa 27f ( )
so that the energy associated with the nth line is 11%?
= ~ 3.7
9 E" 871.2I ( ) O 21r F‘G‘ III'2'_Ceus in phase In terms of these cells, we can now under—
space, for the rotator. The shaded area. has an area. of h stand one of the most fundamental statements
in the quantum them“ of the quantum theory, the principle of uncer—
tainty: it is impossible to regulate the coordinates and momenta of asystem
more accurately than to require that they lie somewhere Withln a g1ven cell.
Any attempt to be more precise, on account of the necessary clumsmess
of nature, will result in a disturbance of the system Just great enough to SEC. 3] . STATISTICAL MECHANICS 41 shift the representative points in an unpredictable way from one part of
the cell to another. The best we can do in setting up an assembly, in
other words, is to specify what fraction of the systems will be found in
each quantum state or complexion, or to give the f,’s. This does not
imply by any means, however, that it does not make sense to talk about
the coordinates and momenta of particles with more accuracy than to
locate the representative point in a given cell. There is nothing inher—
ently impossible in knowing the coordinates and momenta of a system as
accurately as we please; the restriction is only that we cannot prepare a
system, or an assembly of systems, with as precisely determined coordi
nates and momenta as we might please. Since we may be interested in precise values of the momenta and
coordinates of a system, there must be something in the mathematical
framework of the theory to describe them. We must be able to answer
questions of this sort: given, that an assembly has a given fraction of its
systems in each cell of phase space, what is the probability that a certain
quantity, such as one of the coordinates, lies within a certain inﬁnitesimal
range of values? Put in another way, if we know that a system is in a
given cell, what is the probability that its coordinates and momenta lie
in deﬁnite ranges? The quantum theory, and speciﬁcally the wave
machanics, can answer such questions; and because it can, we are justiﬁed
in regarding it as an essentially statistical theory. By experimental
methods, we can insure that a system lies in a given cell of phase space.
That is, we can prepare an assembly all of whose representative points lie
in this single cell, but this is the nearest we can come to setting up a sys—
tem of quite deﬁnite coordinates and momenta. Having prepared such
an assembly, however, quantum theory says that the coordinates and
momenta will be distributed in phase space in a deﬁnite way, quite inde—
pendent of the way we prepared the assembly, and therefore quite unpre—
dictable from the previous history of the system. In other words, all
that the theory can do is to give us statistical information about a system,
not detailed knowledge of exactly what it will do. This is in striking
contrast to the classical mechanics, which allows precise prediction of the
future of a system if we know its past history. The cells of the type described in Figs. III—1 and III2 have a special
property: all the systems in such a quantum state have the same energy.
The momenta and coordinates vary from system to system, roughly as if
systems were distributed uniformly through the cell, as for example
through the shaded area of either ﬁgure, though as a matter of fact the
real distribution is much more complicated than this. But the energy is
ﬁxed, the same for all systems, and is referred to as an energy level. It is
equal to some intermediate energy value within the cell in phase space, as
computed classically. Thus for the oscillator, as a matter of fact, the 42 INTRODUCTION TO CHEMICAL PH YSI CS [CHAR III energy levels are
E. = (n + 3);”, (3.8) which, as we see from Eq. (3.4), is the energy value in the middle of the
cell, and for a rotator the energy value is hz
81r21’ En = n(n + l) (3.9)
approximately the mean value through the cell. The integer n is called
the quantum number. The distribution of points in a quantum state of
ﬁxed energy is independent of time, and for that reason the state is called
a stationary state. This is in contrast to other ways of setting up cells.
For instance, with rectangular cells, we ﬁnd in general that the systems in
one state have a distribution of energies, and as time goes on systems jump
at a certain rate from one state to another, having what are called quan
tum transitions, so that the number of systems in each state changes with
time. One can draw a certain parallel, or correspondence, between the
jumping of systems from one quantum state to another, and the uniform
ﬂow of representative points in the phase space in classical mechanics.
Suppose we have a classical assembly whose density in the phase space
changes very slowly from point to point, changing by only a small amount
in going from what would be one quantum cell to another. Then we can
set up a quantum assembly, the fraction of systems in each quantum state
being given by the fraction of the classical systems in the corresponding
cell of phase space. And the time rate of change of the fraction of sys
tems in each quantum state will be given, to a good approximation, by
the corresponding classical value. This correspondence breaks down,
however, as soon as the density of the classical assembly changes greatly
from cell to cell. In that case, if we set up a quantum assembly as before,
we shall ﬁnd that its time variation does not agree at all accurately with
what we should get by use of our classical analogy. Actual atomic systems obey the quantum theory, not classical
mechanics, so that we shall be concerned with quantum statistics. The
only cases in which we can use classical theory as an approximation are
those in which the density in phase varies only a little from state to state, —the case we have mentioned in the last paragraph. As a matter of fact,
as we shall see later, this corresponds roughly to the limit of high tempera
ture. Thus, we shall often ﬁnd that classical results are correct at high
temperatures but break down at low temperature. A typical example of
this is the theory of speciﬁc heat; we shall ﬁnd others as we go on. We
now understand the qualitative features of quantum statistics well enough
so that in the next section we can go on to our task of understanding the SEC. 4] STATISTICAL MECHANICS 43 nature of irreversible processes and the way in which the entropy increases
with time in such processes. 4. Irreversible Processes—We shall start our discussion of irreversi
ble processes using classical mechanics and Liouville’s theorem. Let us
try to form a picture of what happens when we start with a system out of
equilibrium, with constant energy and volume, follow its irreversible
change into equilibrium, and examine its ﬁnal steady state. To have a
speciﬁc example, consider the approach to equilibrium of a perfect gas
having a distribution of velocities which originally does not correspond
to thermal equilibrium. Assume that at the start of an experiment, a
mass of gas is rushing in one direction with a large velocity, as if it had just
been shot into a container from a jet. This is far from an equilibrium
distribution. The random kinetic energy of the molecules, which we
should interpret as heat motion, may be very small and the temperature
low, and yet they have a lot of kinetic energy on account of their motion
in the jet. In the phase space, the density function will be large only in
the very restricted region where all molecules have almost the same
velocity, the velocity of the jet (that is, the equations p11 _ p22  = Vt, etc.,
m; 1112 _
where V, is the :1: component of velocity of the jet, are almost satisﬁed by
all points in the assembly), and all have coordinates near the coordinate
of the center of gravity of the rushing mass of gas (that is, the equations
2:; = $2 =  o o = X, where X is the :2: coordinate of the center of gravity
of the gas, are also approximately satisﬁed). 'We see, then, that the entropy, as deﬁned by —k2f.~ 111 f;, will be small under these conditions. But as time goes on, the distribution will change. The jet of molecules
will strike the opposite wall of the container, and after bouncing back
and forth a few times, will become more and more dissipated, with irregu—
lar currents and turbulence setting in. At ﬁrst we shall describe these
things by hydrodynamics or aerodynamics, but we shall ﬁnd that the
description of the ﬂow gets more and more complicated with irregularities
on a smaller and smaller scale. Finally, with the molecules colliding
with the walls and with each other, things will become extremely involved,
some molecules being slowed down, some speeded up, the directions
changed, so that instead of having most of the molecules moving with
almost the same velocity and located at almost the same point of space,
there will be a whole distribution of momentum, both in direction and
magnitude, and the mass will cease its concentration in space and will be
uniformly distributed over the container. There will now be a great 44 INTRODUCTION TO CHEMICAL PHYSICS [CHAP. III many points of phase space representing states of the system which could
equally well be this ﬁnal state, so that the entropy will be large. And the
increase of entropy has come about at the stage of the process where we
cease to regard the complication in the motion as large—scale turbulence,
and begin to classify it as randomness on a microscopic or atomic scale.
Finally the gas will come to an equilibrium state, in which it no longer
changes appreciably with time, and in this state it will have reached its
maximum entropy consistent with its total energy. This qualitative argument shows what we understand by an irreversi—
ble process and an increase of entropy: an assembly, originally concen—
trated in phase space, changes on account of the motion of the system in
such a way that the points of the assembly gradually move apart, ﬁlling
up larger and larger regions of phase space. This is likely, for there are
many ways in which it can happen; while the reverse process, a concentra
tion of points, is very unlikely, and we can for practical purposes say that
it does not happen. The statement we have just made seems at ﬁrst to be directly con
trary to Liouville’s theorem, for we have just said that points originally
concentrated become dispersed, while Liouville’s theorem states that as
we follow along with a point, the density never changes at all. We can
give an example used by Gibbs1 in discussing this point. Suppose we
have a bottle of fluid consisting of two different liquids, one black and
one white, which do not mix with each other. We start with one black
drop in the midst of the white liquid, corresponding to our concentrated
assembly. Now we shake or stir the liquid. The black drop Will become
shaken into smaller drops, or be drawn out into thin ﬁlaments, which will
become dispersed through the white liquid, ﬁnally forming something like
an emulsion. Each microscopic black drop or ﬁlament is as black as
ever, corresponding to the fact that the density of points cannot change in
the assembly. But eventually the drops will become small enough and
uniformly enough dispersed so that each volume element within the bottle
will seem uniformly gray. This is something like what happens in the
irreversible mixing of the points of an assembly. Just as a droplet of
black ﬂuid can break up into two smaller droplets, its parts traveling in
different directions, so it can happen that two systems represented by
adjacent representative points can separate and have quite different
histories; one may be in position for certain molecules to collide, while the
other may be just different enough so that these moleculesdo not collide
at all, for example. Such chance events will result in very different
detailed histories for the various systems of an assembly, even if the
original systems of the assembly were quite similar. That is, they will 1J. W. Gibbs, “Elementary Principles in Statistical Mechanics,” Chap. XII,
Longmans, Green & Company. SEC. 4k STATISTICAL JlIECIIANICS 45 result in representative points which were originally close together in
phase space moving far apart from each other. From the example and the analogy we have used, we see that in an
irreversible process the points of the original compact and orderly assem—
bly gradually get dissipated and mixed up, with consequent increase of
entropy. Now let us see how the situation is affected when we consider
the quantum theory and the ﬁnite size of cells in phase space. Our
description of the process will depend a good deal on the scale of the
mixing involved in the irreversible process. So long as the mixing is on a
large scale, by Liouville’s theorem, the points that originally were in one
cell will simply be moved bodily to another cell, so that the contribution
of these points to ——IcEf. ln f, will be the same as in the original distribu—
tion, and the entropy will be unchanged. The situation is very different,
however, when the distribution as we should describe it by classical
mechanics involves a set of ﬁlaments, of different densities, on a scale
small compared to a cell. Then the quantum ff, rather than equaling the
classical value, will be more nearly the average of the classical values
through the cell, leading to an increase of entropy, at the same time that
the average or quantum density begins to disobey Liouville’s theorem. It is at this same stage of the process that it becomes really impossible
to reverse the motion. It is a wellsknown result of Newton’s laws that
if, at a given instant, all the positions of all particles are left unchanged,
but all velocities are reversed in direction, the whole motion will reverse,
and go back over its past history. Thus every motion is, in theory, rever—
sible. that is it that in practice makes some motions reversible, others
irreversible? It is simply the practicability of setting up the system with
reversed velocities. If the distribution of velocities is on a scale large
enough to see and work with, there is nothing making a reversal of the
velocities particularly hard to set up. With our gas, we could suddenly
interpose perfectly reﬂecting surfaces normal to the various parts of the
jet of gas, reversing the velocities on collision, or could adopt some such
device. But if the distribution of velocities is on too small a scale to see
and work with, we have no hope of reversing the velocities experimentally.
Considering our emulsion of black and white ﬂuid, which we have pro—
duced by shaking, there is no mechanical reason why the fluid could not
be unshaken, by exactly reversing all the motions that occurred in shaking
it. But nobody would be advised to try the experiment. It used to be considered possible to imagine a being of ﬁner and more
detailed powers of observation than ours, who could regulate systems on a
smaller scale than we could. Such a being could reverse processes that
we could not; to him, the deﬁnition of a reversible process would be differ—
ent from what it is to us. Such a being was discussed by Maxwell and is
often called “Maxwell’s Demon.” Is it possible, we may well ask, to 46 INTRODUCTION TO CHEMICAL PHYSICS [CHAR III imagine demons of any desired degree of reﬁnement? If it is, we can
make any arbitrary process reversible, keep its entropy from increasing,
and the second law of thermodynamics will cease to have any signiﬁ—
cance. The answer to this question given by the quantum theory is
No. An improvement in technique can carry us only a certain distance,
a distance practically reached in plenty of modern experiments with
single atoms and electrons, and no conceivable demon, operating accord
ing to the laws of nature, could carry us further. The quantum theory
gives us a fundamental size of cell in the phase space, such that we cannot
regulate the initial conditions of an assembly on any smaller scale. And
this fundamental cell furnishes us with a unique way of deﬁning entropy
and of judging whether a given process is reversible or irreversible. 5. The Canonical Assembly.——In the preceding section, we have
shown that our entropy, as deﬁned in Eq. (1.2), has one of the properties
of the physical entropy: it increases in an irreversible process, for it
increases whenever the assembly becomes diffused or scattered, and this
happens in irreversible processes. \Ve must next take up thermal equilib~
ium, ﬁnding ﬁrst the correct assembly to describe the density function in
thermal equilibrium, and then proving, from this density function, that
our entropy satisﬁes the condition (18 = dQ/ T for a reversible process.
From Liouville’s theorem, we have one piece of information about the
assembly: in order that it may be independent of time, the quantity f,
must be a function only of the energy of the system. We let E. be the
energy of a system in the ith cell, choosing for this purpose the type of
quantum cells representing stationary states or energy levels. Then we
wish to have f, a function of E;, but we do not yet see how to determine this function. The essential method which we use is the following: \Ve have seen that 4 in an irreversible process, the entropy tends to increase to a maximum, for
an assembly of isolated systems. If all systems of the assembly have the
same energy, then the only cells of phase space to which systems can
travel in the course of the irreversible process are cells of this same energy, ——a ﬁnite number. The distribution of largest entropy in such a case, as
we have seen in Sec. 1, is that in which systems are distributed with
uniform density through all the available cells. This assembly is called
the microcanonical assembly, and it satisﬁes our condition that the
density be a function of the energy only: all the fi’s of the particular
energy represented in the assembly are equal, and all other fg’s are zero.
But it is too specialized for our purposes. For thermal equilibrium, we
do not demand that the energy be precisely determined. We demand
rather that the temperature of all systems of the assembly be the same.
This can be interpreted most properly in the following way. We allow
each system of the assembly to be in contact with a temperature bath of SEC. 5] STATISTICAL MECHANICS 47 the required temperature, a body of very large heat capacity held at the
desired temperature. The systems of the assembly are then not isolated.
Rather, they can change their energy by interaction with the temperature
bath. Thus, even if we started out with an assembly of systems all of the
same energy, some would have their energies increased, some decreased,
by interaction with the bath, and the ﬁnal stable assembly would have a
whole distribution of energies. There would certainly be a deﬁnite aver
age energy of the assembly, however; with a bath of a given temperature,
it is obvious that systems of abnormally low energy will tend to gain
energy, those of abnormally high energy to lose energy, by the interaction.
To ﬁnd the ﬁnal equilibrium state, then, we may ask this question: what
is the assembly of systems which has the maximum entropy, subject only
to the condition that its mean energy have a given value? It seems most
reasonable that this will be the assembly which will be the ﬁnal result of
the irreversible contact of any group of systems with a large temperature
bath. The assembly that results from these conditions is called the canonical
assembly. Let us formulate the conditions which it must satisfy. It must be the assembly for which S = —k2f,~ ln 1'; is a maximum, subject
to a constant mean energy. But we can ﬁnd the mean energy immedi ately in terms of our distribution function fi. In the ith cell, a system has
energy E;. The fractionf; of all systems will be found in this cell. Hence
the weighted mean of the energies of all systems is U = This quantity must be held constant in varying the f{,S. Also, as we saw
in Eq. (1.1), the quantity 2f, equals unity. This must always be satis ﬁed, no matter how the fi’s vary. We can restate the conditions, by
ﬁnding (16' and dU: we must have d8 = o = 42.112 (111 f. + 1), (5.2)
for all sets of dfg’s for which simultaneously
dU = 0 = 2df;E., (5.3)
and i
0 = 2w. (5.4) 48 INTRODUCTION TO CHEMICAL PHYSICS [CHAP. 111
On account of Eq. (5.4), we can rewrite Eq. (5.2) in the form
d8 = o = —k2df; ln 1}. (5.5) The set of simultaneous equations (5.3), (5.4), (5.5) can be handled by the
method called undetermined multipliers: the most general value which
1n f, can have, in order that dS should be zero for any set.of dfi’s for which
Eqs. (5.3) and (5.4) are satisﬁed, is a linear combination of the coefﬁ—
cients of (If.. in Eqs. (5.3) and (5.4), with arbitrary coefﬁcients: 111 f, = a + 1210,. (5.6)
For if Eq. (5.6) is satisﬁed, Eq. (5.5) becomes d8 = — IcEdfda + M.)
= ~ka2df, — kbzdfaEa, (57) which is zero for any values of (If; for which Eqs. (5.3) and (5.4) are satis ﬁed. ‘
The values of f; for the canonical assembly are determined by Eq. (5.6). It may be rewritten
f, = eae’mi. (5.8) Clearly I) must be negative; for ordinary systems have possible_states of
inﬁnite energy, though not of negatively inﬁnite energy,‘and if b were
positive, f, would become inﬁnite for the states of inﬁnite energy, an
impossible situation. We may easily evaluate the constant a 111 terms of b, from the condition 2f; = 1. This gives at once eazew, = 1,
i l 26"”: :5 6“: J so that can,
f1. = w. (5.9)
e i 2 If the assembly (5.9) represents thermal equilibrium, the_ change of
entropy when a certain amount of heat is absorbed in a reversrble process SEC. 5] STATISTICAL MECHANICS 49 should be dQ/T. The change of entropy in any process in thermal
equilibrium, by Eqs. (5.5) and (5.9), is d8 = —k2df.1nf. = —k2df.(bn. — ln 2am) J = _kb2df.E., {510) using Eq. (5.4). Now consider the change of internal energy. This is dU = 203, (If. +1. (115.). (5.11)
The ﬁrst term in Eq. (5.11) arises when the external forces stay constant,
resulting in constant values of Eg, but there is a change in the assembly,
meaning a shift of molecules from one position and velocity to another.
This change of course is different from that considered in Eq. (5.3), for
that referred to an irreversible approach to equilibrium, while this refers
to a change from one equilibrium state to another of different energy.
Such a change of molecules on a molecular scale is to be interpreted as an
absorption of heat. The second term, however, comes about when the
fi’s and the entropy do not change, but the energies of the cells themselves
change, on account of changes in external forces and in the potential
energy. This is to be interpreted as external work done on the system, or
the negative of the work done by the system. Thus we have dQ = df., dW = ~21. c113,. (5.12)
Combining Eq. (5.12) with Eq. (5.11) gives us the ﬁrst law,
dU = dQ — dW.
Combining with Eq. (5.10), we have
d8 = —ch dQ. (5.13) Equation (5.13), stating the proportionality of £18 and (IQ for a reversible process, is a statement of the second law of thermodynamics for areversi—
ble process, if we have 1 1
71'?’ b — —797,‘ (5.14) —kb =
Using Eq. (5.14), we can identify the constants in Eq. (5.9), obtain—
ing as the representation of the canonical assembly —E;/IcT fi (3
= ~——— (5.15
*6. 26—127” ‘ )
i 50 INTRODUCTION TO CHEAIICAL PHYSICS [CHAR 111 It is now Interesting to compute the Helmholtz free energy A = U — TS.
This, using Eqs. (5.1) and (5.15), is Ei
A = 2f.<E.  E. — kT In 267?)
1 22; I
= —kT In 26 “3 (5.16)
i
or
1 _EL
6 "T = Z = e "T (5.17)
1‘
Using Eq. (5.17), we may rewrite the formula (5.15) as
(A—Er)
f. = e W . (5.18) The result of Eq. (5.17) is, for practical purposes, the most important
result of statistical mechanics. For it gives a perfectly direct and
straightforward way of deriving the Helmholtz free energy, and hence
the equation of state and speciﬁc heat, of any system, if we know its
energy as a function of coordinates and momenta. The sum of Eq.
(5.17), which we have denoted by Z, is often called the partition function.
Often it is useful to be able to derive the entropy, internal energy, and
speciﬁc heat directly from the partition function, without separately
computing the Helmholtz free energy. For the entropy, using _ _<§é
" 6’." y’ we have
a kT 62
S = {a—T(kT ln Z)}V — k In Z + —Z—<ﬁ)v (5.19)
For the internal energy, U = A + TS, we have
kT2 aZ _ _ Z 61' y = (5.20) (36%)); where the last form is often useful. For the speciﬁc heat at constant SEC. 5] STATISTICAL MECHANICS 51 volume, we may use either Cy = (GU/6T)y or C,» = T(6S/6T)y. From
the latter, we have (5.21) _ 62(kT1n Z)
CV w T(—8‘TT_‘)VI We have stated our deﬁnitions of entropy, partition function, and
other quantities entirely in terms of summations. Often, however, the
quantity f. changes only slowly from cell to cell; in this case it is con—
venient to replace the summations by integrations over the phase space.
We recall that all cells are of the same volume, h", if there are n coordi—
nates and n momenta in the phase space. Thus the number of cells in a
volume element dql . . . dqn dpl . . . (11),. of phase space is dQ1 . . . dpn.
h" Then the partition function becomes 1 3
z: "(Minde a very convenient form for such problems as ﬁnding the partition function
of a perfect gas. (5.22) ...
View
Full Document
 Spring '09
 Physical chemistry, Thermodynamics, pH, Energy, Statistical Mechanics, Entropy, representative, phase space

Click to edit the document details