Skip to main content

Posts

Showing posts with the label statistical mechanics

The Canonical Ensemble

# The Canonical Ensemble This framework describes a system in thermal equilibrium with a heat reservoir. Unlike the Microcanonical ensemble (fixed \(E\)), here the Temperature \(T\) is fixed, and energy fluctuates. 1. Derivation of the Canonical Probability System Setup We consider a composite system \(A^0\) which is isolated (Microcanonical) with total energy \(E^0\). It is divided into two parts: System \(A\): The small system of interest (energy \(E_r\)). Reservoir \(A'\): A large heat bath (energy \(E'\)). The conservation of energy requires: \( E_r + E' = E^0 \implies E' = E^0 - E_r \). The Probability Condition We ask: What is the probability \(P_r\) of finding system \(A\) in a specific microstate \(r\) with energy \(E_r\)? According to the principle of equal a priori probability, \(P_r\) is proportional to the number of microstates available to the reservoir when system \(A\) is in state \(r...

Statistical Mechanics of Paramagnetism

Statistical Mechanics of Paramagnetism These notes develop the statistical description of an ideal paramagnet starting from microscopic states. Using the Microcanonical Ensemble, we derive the average magnetization, probabilities of spin states, and the statistical definition of temperature. 1. Microscopic Description The General Quantum Hamiltonian In a complete quantum mechanical treatment, the Hamiltonian for a charged particle in an electromagnetic field is given by: \[ H = \frac{1}{2m}\left(\vec{p} - \frac{e}{c}\vec{A}\right)^2 + \mu \vec{S} \cdot \vec{B} \] Expanding this Hamiltonian reveals two distinct magnetic effects: Diamagnetism: Arising from the \( (\vec{p} - \frac{e}{c}\vec{A})^2 \) orbital term. Paramagnetism: Arising from the \( \mu \vec{S} \cdot \vec{B} \) spin interaction term. The Ideal Paramagnet Hamiltonian ...

The Virial Theorem & Thermal Equilibrium

The Virial Theorem & Thermal Equilibrium This section covers two distinct but fundamental topics in statistical mechanics. First, the Virial Theorem , which serves as a tool to understand how real gases deviate from ideal behavior by relating kinetic energy to interaction forces. Second, we derive the conditions for Thermal Equilibrium using the microcanonical ensemble, providing the rigorous statistical definition of temperature. 1. The Virial Theorem The Virial Theorem links the long-term average of the kinetic energy of a stable system to the forces acting within it. It is particularly useful for deriving the Equation of State for interacting systems (real gases). Statement and Formula The theorem states that the average kinetic energy \( \langle T \rangle \) is related to the "Virial" of the forces: \[ \langle T \rangle = -\frac{1}{2} \sum_{i} \langle \mathbf{r}_i \cdot \mathb...

The Microcanonical Ensemble

The Microcanonical Ensemble: Geometry & Equipartition This guide details the statistical mechanics of isolated systems (fixed \(E\), \(V\), \(N\)). By analyzing the geometry of phase space surfaces, we derive the fundamental definition of temperature and provide a rigorous proof of the Equipartition Theorem. 1. Statement and Hypothesis The Ergodic Hypothesis: If we follow the time evolution of a particular point in phase space, it will visit any region of the available phase space with equal probability over a long period. For a closed system with fixed Energy \(E\) and Particle Number \(N\), the Hamiltonian is constrained such that \(H(q,p) = E\). Geometrically, this means the system will always exist on a hypersurface of dimension \(2f-1\) (where \(f\) is the number of degrees of freedom). 2. The Density of States To describe the system mathematically, we define the probab...

Liouville's Theorem

Liouville's Theorem: Conservation of Phase Space Density Liouville's Theorem is a fundamental result in classical mechanics that connects the deterministic laws of motion (Hamilton's equations) with statistical descriptions of large systems. It states that phase space behaves like an incompressible fluid: as a system evolves, the "cloud" of possible states may distort, but its volume remains constant. 1. The Statement Let \( \rho(q, p, t) \) be the probability density of finding a system at coordinates \( (q, p) \) in phase space at time \( t \). Liouville's Theorem asserts that the density of states in the immediate neighborhood of a moving point in phase space remains constant: \[ \frac{d\rho}{dt} = \frac{\partial \rho}{\partial t} + \{ \rho, H \} = 0 \] Where \( \{ \rho, H \} \) is the Poisson bracket. Geometrically, this implies the conservation of phase space volume. 2. D...

The Ergodic Hypothesis

The Ergodic Hypothesis: Bridging Dynamics and Thermodynamics How do we justify replacing impossible calculations of molecular trajectories with simple statistical probabilities? The answer lies in the Ergodic Hypothesis . It is the fundamental pillar of Statistical Mechanics that equates the long-term behavior of a single system with the average behavior of an infinite collection of systems. 1. The Conflict: Experiment vs. Theory To understand why the Ergodic Hypothesis is necessary, we must distinguish between two types of averages: The Time Average (Experiment) When you measure a property (like pressure) in the lab, the measurement takes time. Since molecules collide every \( 10^{-14} \) seconds, any measurement is effectively an average over time. For a dynamic variable \( f(q, p) \), the time average is: \[ \bar{f} = \lim_{T \to \infty} \frac{1}{T} \int_0^T f(q(t), p(t)) \, dt \] The Ensemble...

Paramagnetism: Microcanonical Ensemble Formalism

# Paramagnetism: Microcanonical Ensemble Formalism This derivation explores the statistical mechanics of an ideal paramagnet using the Microcanonical Ensemble . Unlike the canonical approach where temperature is fixed, here we fix the total energy and derive temperature as a statistical property. 1. Physical Model and Assumptions We consider an ideal paramagnetic system defined by the following assumptions: The system consists of \(N\) identical, non-interacting spins. Each spin carries a magnetic moment \(\mu\). An external uniform magnetic field \(\mathbf{H} = H \hat{z}\) is applied. Only spin degrees of freedom contribute (orbital angular momentum \(L=0\)). Spins are treated as discrete variables. 2. Energy of a Single Spin The potential energy of the \(i\)-th magnetic moment in the external field is: \[ \varepsilon_i = -\boldsymbol{\mu}_i \cdot \mathbf{H} \] For a spin-1/2 system, the spin variable \(\sigma_i...

Ensemble Theory

# Ensemble Theory: Complete Step-by-Step Derivation This document provides the foundational derivation of statistical mechanics, starting from the classical phase space description to the formulation of the Microcanonical, Canonical, and Grand Canonical ensembles. STEP 1: Phase Space Description Consider a classical system consisting of \(N\) particles. The state of each particle \(i\) is defined by: Position: \(\mathbf{q}_i = (q_{ix}, q_{iy}, q_{iz})\) Momentum: \(\mathbf{p}_i = (p_{ix}, p_{iy}, p_{iz})\) The state of the entire system at any instant is represented by a single point in a \(6N\)-dimensional space called Phase Space . \[ \Gamma = (\mathbf{q}_1, \dots, \mathbf{q}_N; \mathbf{p}_1, \dots, \mathbf{p}_N) \] Dimension of Phase Space: \(\dim(\Gamma) = 6N\). STEP 2: Density Function Since we cannot track the exact trajectory of \(10^{23}\) particles, we use a statistical approach. We define an Ensemble as a collectio...

1D Random Walk

Random Walk and Probability: Complete Derivations The one-dimensional random walk is the fundamental model used to teach probability theory in statistical mechanics. It illustrates how microscopic randomness leads to macroscopic predictability (diffusion). Below is the rigorous, step-by-step derivation of every mathematical result in this model, from the binomial distribution to the Gaussian continuum limit. 1. The 1D Random Walk Model Consider a particle moving along a 1D axis (lattice) with step length \( \ell \). Total Steps: \( N \) Step Right: Probability \( p \) Step Left: Probability \( q \) Normalization: \( p + q = 1 \) 2. Defining Position and Variables Let: \( n_1 \): Number of steps to the right. \( n_2 \): Number of steps to the left. The Constraints 1. The total number of steps is fixed: \[ N = n_1 + ...

Entropy & it's connection with information

Entropy as Information: Deriving the Gibbs-Shannon Formula What exactly is entropy? While often loosely defined as "disorder," statistical mechanics offers a much more precise definition: Entropy is the expected value of information. By treating physical events as probabilistic outcomes, we can derive the fundamental equations of thermodynamics from pure logic. 1. Information Associated with an Event For any physical event occurring with probability \( p \), we associate a quantity called Information, \( I(p) \). To make physical sense, this quantity must satisfy three logical properties: (i) Non-negativity: \[ I(p) \ge 0 \] Physical meaning: Observing an event cannot reduce your knowledge. You can learn something, or you can learn nothing, but you cannot be "negatively surprised." (ii) Additivity for Independent Events: \[ I(p_1 p_2) = I(p_1) + I...

Probability Theory: for stat mech

Probability Theory: The Language of Statistical Mechanics Statistical Mechanics bridges the microscopic world of particles with the macroscopic world of thermodynamics. To do this, it relies entirely on the mathematical framework of probability. This post defines the foundational concepts—from sets and axioms to covariance—that are necessary to understand ensembles, entropy, and fluctuations. [INSERT DIAGRAM OF SAMPLE SPACE AND EVENTS HERE] 1. Sets and Events (Foundations) In set theory, a set is simply a collection of objects. \( x \in A \): Element \( x \) belongs to set \( A \). \( B \subset A \): \( B \) is a subset of \( A \). The Physics Connection In probability theory applied to physics: Sample Space (\( \Omega \)): The set of all possible outcomes. In statistical mechanics, this is the set of all possible microstates . \[ \Omega = \{ \text{all possible outc...

Derivation of resistivity

Derivation of Resistivity: Boltzmann Transport Equation In the quantum mechanical view of metals, resistivity arises when the equilibrium distribution of electrons is perturbed by an external electric field. By applying the Boltzmann Transport Equation and the Relaxation Time Approximation, we can mathematically derive the fundamental formula for resistivity, linking microscopic scattering to macroscopic resistance. [INSERT DIAGRAM OF FERMI SURFACE SHIFT HERE] 1. The Electron Gas in Equilibrium Inside a metal, conduction electrons behave like a gas. Their energy \( \varepsilon \) is related to their momentum \( \mathbf{p} \) by: \[ \varepsilon = \frac{p^2}{2m} \] They populate energy states according to the Fermi-Dirac distribution \( f_0 \): \[ f_0(\varepsilon) = \frac{1}{e^{(\varepsilon-\mu)/k_B T} + 1} \] In this state, for every electron moving left, one moves right. The net curren...