Probability theory becomes conceptually complete when it is formulated as measure theory with total mass one. The benefit is not abstraction for its own sake. The measure-theoretic framework tells you exactly which sets can be assigned probabilities without contradiction, which functions can be treated as random variables, and why the operations that dominate probability—limits, conditioning, and independence—work reliably. It also unifies discrete and continuous models under one definition of expectation: integration.
This article develops the core objects of measure-theoretic probability and shows, by example, how each definition is forced by the kinds of problems probability routinely asks.
Premium Gaming TV65-Inch OLED Gaming PickLG 65-Inch Class OLED evo AI 4K C5 Series Smart TV (OLED65C5PUA, 2025)
LG 65-Inch Class OLED evo AI 4K C5 Series Smart TV (OLED65C5PUA, 2025)
A premium gaming-and-entertainment TV option for console pages, living-room gaming roundups, and OLED recommendation articles.
- 65-inch 4K OLED display
- Up to 144Hz refresh support
- Dolby Vision and Dolby Atmos
- Four HDMI 2.1 inputs
- G-Sync, FreeSync, and VRR support
Why it stands out
- Great gaming feature set
- Strong OLED picture quality
- Works well in premium console or PC-over-TV setups
Things to know
- Premium purchase
- Large-screen price moves often
Why “all subsets” cannot be events
Start with a set of outcomes $\Omega$. An “event” is meant to be a \subset $A\subseteq \Omega$ \to which a probability is assigned. If $\Omega$ is finite, defining a probability on all subsets is easy: specify weights on points and sum them. For uncountable spaces, trying to assign probabilities to all subsets breaks essential properties such as translation invariance and countable additivity. In the real line, for example, there exist nonmeasurable sets for which no consistent “length” can be defined while keeping the usual symmetries. Probability inherits the same obstruction.
The correct repair is to specify a collection $\mathcal{F}$ of subsets called the measurable sets. This is not a loss of generality in practice: $\mathcal{F}$ is chosen large enough to contain all events you can build from the model’s basic observables by countable operations.
σ-Algebras: stability under limits of events
A σ-algebra $\mathcal{F}$ on $\Omega$ is a collection of subsets satisfying:
- $\Omega\in\mathcal{F}$,
- $A\in\mathcal{F}\Rightarrow A^c\in\mathcal{F}$,
- $A_1,A_2,\dots\in\mathcal{F}\Rightarrow \bigcup_{n=1}^\infty A_n\in\mathcal{F}$.
From these axioms, $\mathcal{F}$ is also closed under countable intersections and set differences. The countability requirement is the point. Many probabilistic constructions use sequences: events like “$X_n$ eventually stays below 1,” “a random walk hits a state infinitely often,” or “$X_n\to X$” are built from countable unions and intersections. Without countable closure, those events might not even be defined.
A probability measure $P$ on $(\Omega,\mathcal{F})$ is a function $P:\mathcal{F}\to[0,1]$ such that:
- $P(\Omega)=1$,
- for pairwise disjoint events $A_1,A_2,\dots\in\mathcal{F}$,
The triple $(\Omega,\mathcal{F},P)$ is a probability space.
Two continuity properties are immediate consequences of countable additivity and are used constantly:
- If $A_n\uparrow A$ (increasing sequence), then $P(A_n)\uparrow P(A)$.
- If $A_n\downarrow A$ and $P(A_1)<\infty$ (automatic here), then $P(A_n)\downarrow P(A)$.
These are the measure-theoretic version of “probability respects limits of events.”
Random variables: measurable functions
A random variable is a measurable function $X:(\Omega,\mathcal{F})\to(\mathbb{R},\mathcal{B})$, where $\mathcal{B}$ is the Borel σ-algebra of $\mathbb{R}$. Measurability means:
Equivalently, it is enough to check sets of the form $(-\infty,t]$, because these generate $\mathcal{B}$:
This definition is not just formal. It is exactly what ensures that events defined by $X$—like $\{X\le t\}$, $\{X\in[a,b]\}$, or $\{X\in B\}$ for complicated $B$—are measurable and therefore have probabilities.
The distribution (law) of $X$ is the pushforward measure $P_X$ on $(\mathbb{R},\mathcal{B})$ defined by
This separates “how $X$ behaves” from “how it is represented on $\Omega$.” Many different probability spaces can support random variables with the same distribution.
Expectation as integration: the unification
In a finite probability space with outcomes $\omega_k$ of probability $p_k$, expectation is a weighted sum $\sum x(\omega_k)p_k$. In a continuous model with density $f$, expectation is $\int x f(x)\,dx$. Measure theory unifies these: expectation is the Lebesgue integral with respect \to $P$:
when $X$ is integrable.
To see why this is forced, start with indicator variables. If $X=\mathbf{1}_A$, then the expectation should be $P(A)$. The integral does exactly that:
For a simple random variable $S=\sum_{k=1}^m a_k\mathbf{1}_{A_k}$ with disjoint $A_k$, linearity gives
Now every nonnegative measurable $X$ can be approximated from below by an increasing sequence of simple functions $S_n\uparrow X$. The Lebesgue integral is defined by
This definition is built to make limits work. That is the essential reason expectation is an integral: probability arguments continually take monotone limits and dominated limits.
For general $X$, write $X=X^+-X^-$ where $X^+=\max(X,0)$ and $X^-=\max(-X,0)$. One defines $\mathbb{E}[X]$ when both $\mathbb{E}[X^+]$ and $\mathbb{E}[X^-]$ are finite.
Convergence theorems: the real pay-off
The following theorems are the workhorses of probability because they justify passing limits through expectations.
Monotone convergence theorem
If $0\le X_n\uparrow X$ almost surely, then
A standard use is truncation: $X_n=X\wedge n$. Many “infinite expectation” phenomena are proved by computing $\mathbb{E}[X\wedge n]$ and letting $n\to\infty$.
Dominated convergence theorem
If $X_n\to X$ almost surely and $|X_n|\le Y$ for an integrable $Y$, then
This is used whenever a parameter is sent \to a limit inside an integral-like expectation, and it clarifies why uniform integrability conditions are needed when domination fails.
Fatou’s lemma
For nonnegative $X_n$,
Fatou provides inequalities when full convergence hypotheses are unavailable.
These are not peripheral results. They are the mechanism by which probabilistic limits become rigorous.
Almost sure statements and modification on null sets
Measure theory distinguishes between holding everywhere and holding outside a probability-zero set. A property holds almost surely if it fails only on a null set. Many constructions in probability produce objects defined only up to null sets. For example, conditional expectations are defined as equivalence classes in $L^1$: changing $\mathbb{E}[X|\mathcal{G}]$ on a null set does not change its defining property.
This matters because “pathwise” regularity of stochastic processes can often be obtained only after modifying the process on a null set. Theorems about versions and modifications rely on this flexibility.
Conditional expectation: conditioning as a σ-algebra projection
Conditioning on an event $B$ is simple: $\mathbb{E}[X|B]$ is the average of $X$ restricted \to $B$. Conditioning on information is subtler. A σ-algebra $\mathcal{G}\subseteq\mathcal{F}$ represents the information available. The conditional expectation $\mathbb{E}[X|\mathcal{G}]$ is the $\mathcal{G}$-measurable random variable satisfying
This definition guarantees that $\mathbb{E}[X|\mathcal{G}]$ reproduces the averages of $X$ on every event in $\mathcal{G}$. When $\mathcal{G}$ is generated by a partition, it reduces to the familiar “average on each cell.” In general, it is the unique object that behaves like an information-based average.
Key properties follow quickly:
- Linearity: $\mathbb{E}[aX+bY|\mathcal{G}]=a\mathbb{E}[X|\mathcal{G}]+b\mathbb{E}[Y|\mathcal{G}]$.
- Tower property: if $\mathcal{H}\subseteq \mathcal{G}$, then $\mathbb{E}[\mathbb{E}[X|\mathcal{G}]|\mathcal{H}]=\mathbb{E}[X|\mathcal{H}]$.
- Taking out what is known: if $Y$ is $\mathcal{G}$-measurable and integrable, then $\mathbb{E}[XY|\mathcal{G}]=Y\mathbb{E}[X|\mathcal{G}]$ under appropriate integrability.
These properties are the algebra behind martingales and stochastic processes.
Independence via generated σ-algebras
Events $A$ and $B$ are independent if $P(A\cap B)=P(A)P(B)$. σ-algebras $\mathcal{A}$ and $\mathcal{B}$ are independent if every event in $\mathcal{A}$ is independent of every event in $\mathcal{B}$. Random variables $X$ and $Y$ are independent if the σ-algebras they generate, $\sigma(X)$ and $\sigma(Y)$, are independent.
This language clarifies two common confusions:
- Pairwise independence of variables is weaker than mutual independence, because independence must hold for all finite intersections of generated events.
- Independence is a statement about events (hence σ-algebras), not about numeric values directly.
The practical message
Measure-theoretic probability provides a stable foundation for the operations probability uses most:
- σ-algebras ensure limits of events remain events.
- Random variables are exactly the measurable functions that generate measurable events.
- Expectation is an integral designed to commute with limits under precise hypotheses.
- Conditional expectation is conditioning on information, not just on a single event.
- Independence is cleanly expressed via generated σ-algebras.
Once these pieces are in place, many advanced results become recombinations of a small set of robust principles: measurability, integrability, convergence theorems, and conditioning.
Books by Drew Higgins
Christian Living / Encouragement
God’s Promises in the Bible for Difficult Times
A Scripture-based reminder of God’s promises for believers walking through hardship and uncertainty.
Leave a Reply