Cameron–Martin theorem

In mathematics, the Cameron–Martin theorem or Cameron–Martin formula (named after Robert Horton Cameron and W. T. Martin) is a theorem of measure theory that describes how abstract Wiener measure changes under translation by certain elements of the Cameron–Martin Hilbert space.

Motivation

The standard Gaussian measure $\gamma ^{n}$ on $n$ -dimensional Euclidean space $\mathbf {R} ^{n}$ is not translation-invariant. (In fact, there is a unique translation invariant Radon measure up to scale by Haar's theorem: the $n$ -dimensional Lebesgue measure, denoted here $dx$ .) Instead, a measurable subset $A$ has Gaussian measure

\gamma _{n}(A)={\frac {1}{(2\pi )^{n/2}}}\int _{A}\exp \left(-{\tfrac {1}{2}}\langle x,x\rangle _{\mathbf {R} ^{n}}\right)\,dx.

Here $\langle x,x\rangle _{\mathbf {R} ^{n}}$ refers to the standard Euclidean dot product in $\mathbf {R} ^{n}$ . The Gaussian measure of the translation of $A$ by a vector $h\in \mathbf {R} ^{n}$ is

{\begin{aligned}\gamma _{n}(A-h)&={\frac {1}{(2\pi )^{n/2}}}\int _{A}\exp \left(-{\tfrac {1}{2}}\langle x-h,x-h\rangle _{\mathbf {R} ^{n}}\right)\,dx\\[4pt]&={\frac {1}{(2\pi )^{n/2}}}\int _{A}\exp \left({\frac {2\langle x,h\rangle _{\mathbf {R} ^{n}}-\langle h,h\rangle _{\mathbf {R} ^{n}}}{2}}\right)\exp \left(-{\tfrac {1}{2}}\langle x,x\rangle _{\mathbf {R} ^{n}}\right)\,dx.\end{aligned}}

So under translation through $h$ , the Gaussian measure scales by the distribution function appearing in the last display:

\exp \left({\frac {2\langle x,h\rangle _{\mathbf {R} ^{n}}-\langle h,h\rangle _{\mathbf {R} ^{n}}}{2}}\right)=\exp \left(\langle x,h\rangle _{\mathbf {R} ^{n}}-{\tfrac {1}{2}}\|h\|_{\mathbf {R} ^{n}}^{2}\right).

The measure that associates to the set $A$ the number $\gamma _{n}(A-h)$ is the pushforward measure, denoted $(T_{h})_{*}(\gamma ^{n}).$ Here $T_{h}:\mathbf {R} ^{n}\to \mathbf {R} ^{n}$ refers to the translation map: $T_{h}(x)=x+h$ . The above calculation shows that the Radon–Nikodym derivative of the pushforward measure with respect to the original Gaussian measure is given by

{\frac {\mathrm {d} (T_{h})_{*}(\gamma ^{n})}{\mathrm {d} \gamma ^{n}}}(x)=\exp \left(\left\langle h,x\right\rangle _{\mathbf {R} ^{n}}-{\tfrac {1}{2}}\|h\|_{\mathbf {R} ^{n}}^{2}\right).

The abstract Wiener measure $\gamma$ on a separable Banach space $E$ , where $i:H\to E$ is an abstract Wiener space, is also a "Gaussian measure" in a suitable sense. How does it change under translation? It turns out that a similar formula to the one above holds if we consider only translations by elements of the dense subspace $i(H)\subseteq E$ .

Statement of the theorem

For abstract Wiener spaces (Banach space setting)

Let $i:H\to E$ be an abstract Wiener space with abstract Wiener measure ${\displaystyle \gamma$ . For $h\in H$ , define $T_{h}:E\to E$ by $T_{h}(x)=x+i(h)$ . Then $(T_{h})_{*}(\gamma )$ is equivalent to $\gamma$ with Radon–Nikodym derivative

{\frac {\mathrm {d} (T_{h})_{*}(\gamma )}{\mathrm {d} \gamma }}(x)=\exp \left(\langle h,x\rangle ^{\sim }-{\tfrac {1}{2}}\|h\|_{H}^{2}\right),

where

\langle h,x\rangle ^{\sim }=i(h)(x)

denotes the Paley–Wiener integral.

The Cameron–Martin formula is valid only for translations by elements of the dense subspace $i(H)\subseteq E$ , called Cameron–Martin space, and not by arbitrary elements of $E$ . If the Cameron–Martin formula did hold for arbitrary translations, it would contradict the following result:

E

is a separable Banach space and

\mu

is a locally finite Borel measure on

E

that is equivalent to its own push forward under any translation, then either

E

has finite dimension or

\mu

is the trivial (zero) measure. (See quasi-invariant measure.)

In fact, $\gamma$ is quasi-invariant under translation by an element $v$ if and only if $v\in i(H)$ . Vectors in $i(H)$ are sometimes known as Cameron–Martin directions.

General version for locally convex vector spaces

Consider a locally convex vector space $E$ , with a Gaussian measure $\gamma$ on the cylindrical σ-algebra $\sigma (\operatorname {Cyl} (E,E'))$ and let $\gamma _{m}:=\gamma (\cdot -m)$ denote the translation by $m\in E$ . For an element in the topological dual $f\in E'$ define the distance to the mean $t_{\gamma }(f):=f-\mathbb {E} _{\gamma }[f],$ and denote the closure in $L^{2}(E,\gamma )$ as $E_{a}^{\gamma }:=\operatorname {clos} \left\{(t_{\gamma }(f_{n}))_{n}\colon \ f\in E'\right\}$ . Define the covariance operator ${\overline {R_{\gamma }}}:E_{a}^{\gamma }\to (E')^{*}$ extended to the closure as

{\overline {R_{\gamma }}}(f)(g)=\langle f,g-\mathbb {E} _{\gamma }[g]\rangle _{L^{2}(\gamma )}

Define the norm

\|h\|_{H_{\gamma }}:=\sup\{f(h)\colon f\in E',\;{\overline {R_{\gamma }}}(f)(f)\leq 1\},

then the Cameron–Martin space $H_{\gamma }$ of $\gamma$ in $E$ is

H_{\gamma }=\{h\in E\colon \|h\|_{H_{\gamma }}<\infty \}

If for $h\in E$ there exists an $g\in E_{a}^{\gamma }$ such that $h={\overline {R_{\gamma }}}(g)$ then $h\in H_{\gamma }$ and $\|h\|_{H_{\gamma }}=\|g\|_{L^{2}(\gamma )}$ . Further there is equivalence $\gamma _{h}\sim \gamma$ with Radon-Nikodým density

{\frac {d\gamma _{h}}{d\gamma }}=\exp \left(g(x)-{\frac {1}{2}}\|h\|_{H_{\gamma }}^{2}\right).

If $h\not \in H_{\gamma }$ the two measures are singular.^[1]

Integration by parts

The Cameron–Martin formula gives rise to an integration by parts formula on $E$ : if $F:E\to \mathbf {R}$ has bounded Fréchet derivative $\mathrm {D} F:E\to \operatorname {Lin} (E;\mathbf {R} )=E^{*}$ , integrating the Cameron–Martin formula with respect to Wiener measure on both sides gives

\int _{E}F(x+ti(h))\,\mathrm {d} \gamma (x)=\int _{E}F(x)\exp \left(t\langle h,x\rangle ^{\sim }-{\tfrac {1}{2}}t^{2}\|h\|_{H}^{2}\right)\,\mathrm {d} \gamma (x)

for any $t\in \mathbf {R}$ . Formally differentiating with respect to $t$ and evaluating at $t=0$ gives the integration by parts formula

\int _{E}\mathrm {D} F(x)(i(h))\,\mathrm {d} \gamma (x)=\int _{E}F(x)\langle h,x\rangle ^{\sim }\,\mathrm {d} \gamma (x).

Comparison with the divergence theorem of vector calculus suggests

\mathop {\mathrm {div} } [V_{h}](x)=-\langle h,x\rangle ^{\sim },

where $V_{h}:E\to E$ is the constant "vector field" $V_{h}(x)=i(h)$ for all $x\in E$ . The wish to consider more general vector fields and to think of stochastic integrals as "divergences" leads to the study of stochastic processes and the Malliavin calculus, and, in particular, the Clark–Ocone theorem and its associated integration by parts formula.

An application

Using Cameron–Martin theorem one may establish (See Liptser and Shiryayev 1977, p. 280) that for a $q\times q$ symmetric non-negative definite matrix $H(t)$ whose elements $H_{j,k}(t)$ are continuous and satisfy the condition

\int _{0}^{T}\sum _{j,k=1}^{q}|H_{j,k}(t)|\,dt<\infty ,

it holds for a $q$ −dimensional Wiener process $w(t)$ that

E\left[\exp \left(-\int _{0}^{T}w(t)^{*}H(t)w(t)\,dt\right)\right]=\exp \left[{\tfrac {1}{2}}\int _{0}^{T}\operatorname {tr} (G(t))\,dt\right],

where $G(t)$ is a $q\times q$ nonpositive definite matrix which is a unique solution of the matrix-valued Riccati differential equation

{\frac {dG(t)}{dt}}=2H(t)-G^{2}(t)

with the boundary condition $G(T)=0$ .

In the special case of a one-dimensional Brownian motion where $H(t)=1/2$ , the unique solution is $G(t)=\tanh(t-T)$ , and we have the original formula as established by Cameron and Martin: $E\left[\exp \left(-{\tfrac {1}{2}}\int _{0}^{T}w(t)^{2}\,dt\right)\right]={\frac {1}{\sqrt {\cosh T}}}.$

References

↑ Bogachev, Vladimir (1998). Gaussian Measures. Rhode Island: American Mathematical Society.

Cameron, R. H.; Martin, W. T. (1944). "Transformations of Wiener Integrals under Translations". Annals of Mathematics. 45 (2): 386–396. doi:10.2307/1969276. JSTOR 1969276.
Liptser, R. S.; Shiryayev, A. N. (1977). Statistics of Random Processes I: General Theory. Springer-Verlag. ISBN 3-540-90226-0.
Elworthy, David (2008), MA482 Stochastic Analysis (PDF), Lecture Notes, University of Warwick
Lunardi, Alessandra; Miranda, Michele; Pallara, Diego (2016), Inﬁnite Dimensional Analysis, Lecture Notes, 19th Internet Seminar, Dipartimento di Matematica e Informatica Università degli Studi di Ferrara

v t e Analysis in topological vector spaces
Basic concepts	Abstract Wiener space Classical Wiener space Bochner space Convex series Cylinder set measure Infinite-dimensional vector function Matrix calculus Vector calculus
Derivatives	Differentiable vector-valued functions from Euclidean space Differentiation in Fréchet spaces Fréchet derivative Total Functional derivative Gateaux derivative Directional Generalizations of the derivative Hadamard derivative Holomorphic Quasi-derivative
Measurability	Besov measure Cylinder set measure Canonical Gaussian Classical Wiener measure Measure like set functions infinite-dimensional Gaussian measure Projection-valued Vector Bochner / Weakly / Strongly measurable function Radonifying function Measure theory in topological vector spaces
Integrals	Bochner Direct integral Dunford Gelfand–Pettis/Weak Regulated Paley–Wiener
Results	Cameron–Martin theorem Inverse function theorem Nash–Moser theorem Feldman–Hájek theorem No infinite-dimensional Lebesgue measure Sazonov's theorem Structure theorem for Gaussian measures
Related	Crinkled arc Covariance operator
Functional calculus	Borel functional calculus Continuous functional calculus Holomorphic functional calculus
Applications	Banach manifold (bundle) Convenient vector space Choquet theory Fréchet manifold Hilbert manifold

v t e Stochastic processes
Discrete time	Bernoulli process Branching process Chinese restaurant process Galton–Watson process Independent and identically distributed random variables Markov chain Moran process Random walk Loop-erased Self-avoiding Biased Maximal entropy
Continuous time	Additive process Airy process Bessel process Birth–death process pure birth Brownian motion Bridge Dyson Excursion Fractional Geometric Meander Cauchy process Contact process Continuous-time random walk Cox process Diffusion process Empirical process Feller process Fleming–Viot process Gamma process Geometric process Hawkes process Hunt process Interacting particle systems Itô diffusion Itô process Jump diffusion Jump process Lévy process Local time Markov additive process McKean–Vlasov process Ornstein–Uhlenbeck process Poisson process Compound Non-homogeneous Quasimartingale Schramm–Loewner evolution Semimartingale Sigma-martingale Stable process Superprocess Telegraph process Variance gamma process Wiener process Wiener sausage
Both	Branching process Gaussian process Hidden Markov model (HMM) Markov process Martingale Differences Local Sub- Super- Random dynamical system Regenerative process Renewal process Stochastic chains with memory of variable length White noise
Fields and other	Dirichlet process Gaussian random field Gibbs measure Hopfield model Ising model Potts model Boolean network Markov random field Percolation Pitman–Yor process Point process Cox Determinantal Poisson Random field Random graph
Time series models	Autoregressive conditional heteroskedasticity (ARCH) model Autoregressive integrated moving average (ARIMA) model Autoregressive (AR) model Autoregressive moving-average (ARMA) model Generalized autoregressive conditional heteroskedasticity (GARCH) model Moving-average (MA) model
Financial models	Binomial options pricing model Black–Derman–Toy Black–Karasinski Black–Scholes Chan–Karolyi–Longstaff–Sanders (CKLS) Chen Constant elasticity of variance (CEV) Cox–Ingersoll–Ross (CIR) Garman–Kohlhagen Heath–Jarrow–Morton (HJM) Heston Ho–Lee Hull–White Korn-Kreer-Lenssen LIBOR market Rendleman–Bartter SABR volatility Vašíček Wilkie
Actuarial models	Bühlmann Cramér–Lundberg Risk process Sparre–Anderson
Queueing models	Bulk Fluid Generalized queueing network M/G/1 M/M/1 M/M/c
Properties	Càdlàg paths Continuous Continuous paths Ergodic Exchangeable Feller-continuous Gauss–Markov Markov Mixing Piecewise-deterministic Predictable Progressively measurable Self-similar Stationary Time-reversible
Limit theorems	Central limit theorem Donsker's theorem Doob's martingale convergence theorems Ergodic theorem Fisher–Tippett–Gnedenko theorem Large deviation principle Law of large numbers (weak/strong) Law of the iterated logarithm Maximal ergodic theorem Sanov's theorem Zero–one laws (Blumenthal, Borel–Cantelli, Engelbert–Schmidt, Hewitt–Savage, Kolmogorov, Lévy)
Inequalities	Burkholder–Davis–Gundy Doob's martingale Doob's upcrossing Kunita–Watanabe Marcinkiewicz–Zygmund
Tools	Cameron–Martin theorem Convergence of random variables Doléans-Dade exponential Doob decomposition theorem Doob–Meyer decomposition theorem Doob's optional stopping theorem Dynkin's formula Feynman–Kac formula Filtration Girsanov theorem Infinitesimal generator Itô integral Itô's lemma Kolmogorov continuity theorem Kolmogorov extension theorem Kosambi–Karhunen–Loève theorem Lévy–Prokhorov metric Malliavin calculus Martingale representation theorem Optional stopping theorem Prokhorov's theorem Quadratic variation Reflection principle Skorokhod integral Skorokhod's representation theorem Skorokhod space Snell envelope Stochastic differential equation Tanaka Stopping time/Hitting time Stratonovich integral Uniform integrability Usual hypotheses Wiener space Classical Abstract
Disciplines	Actuarial mathematics Control theory Econometrics Ergodic theory Extreme value theory (EVT) Large deviations theory Mathematical finance Mathematical statistics Probability theory Queueing theory Renewal theory Ruin theory Signal processing Statistics Stochastic analysis Time series analysis Machine learning
List of topics Category

Motivation

Statement of the theorem

For abstract Wiener spaces (Banach space setting)

General version for locally convex vector spaces

Integration by parts

An application

See also

References

Related Essays & Commentary

How to communicate like Him

Earth Microbes Could Survive on the Moon, Raising Contamination Fears Ahead of Artemis

The first post, built on a secure new foundation.

Why We Can't Return to a Pre-Industrial Society