Stationary process
≈ 6 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
In mathematics and statistics, a stationary process (also called a strict/strictly stationary process or strong/strongly stationary process) is a stochastic process whose statistical properties, such as mean and variance, do not change over time. More formally, the joint probability distribution of the process remains the same when shifted in time. This implies that the process is statistically consistent across different time periods.
How it works
Because many statistical procedures in time series analysis assume stationarity, non-stationary data are frequently transformed to achieve stationarity before analysis. A common cause of non-stationarity is a trend in the mean, which can be due to either a unit root or a deterministic trend. In the case of a unit root, stochastic shocks have permanent effects, and the process is not mean-reverting.
With a deterministic trend, the process is called trend-stationary, and shocks have only transitory effects, with the variable tending towards a deterministically evolving mean. A trend-stationary process is not strictly stationary but can be made stationary by removing the trend. Similarly, processes with unit roots can be made stationary through differencing. Another type of non-stationary process, distinct from those with trends, is a cyclostationary process, which exhibits cyclical variations over time.…
In mathematics and statistics, a stationary process (also called a strict/strictly stationary process or strong/strongly stationary process) is a stochastic process whose statistical properties, such as mean and variance, do not change over time. More formally, the joint probability distribution of the process remains the same when shifted in time. This implies that the process is statistically consistent across different time periods.
Because many statistical procedures in time series analysis assume stationarity, non-stationary data are frequently transformed to achieve stationarity before analysis. A common cause of non-stationarity is a trend in the mean, which can be due to either a unit root or a deterministic trend. In the case of a unit root, stochastic shocks have permanent effects, and the process is not mean-reverting.
With a deterministic trend, the process is called trend-stationary, and shocks have only transitory effects, with the variable tending towards a deterministically evolving mean. A trend-stationary process is not strictly stationary but can be made stationary by removing the trend. Similarly, processes with unit roots can be made stationary through differencing. Another type of non-stationary process, distinct from those with trends, is a cyclostationary process, which exhibits cyclical variations over time.
Strict stationarity, as defined above, can be too restrictive for many applications. Therefore, other forms of stationarity, such as wide-sense stationarity or th-order stationarity, are often used. The definitions for different kinds of stationarity are not consistent among different authors (see ). X_t=Y \qquad \text{ for all } t. Then \left\{X_t\right\} is a stationary time series, for which realisations consist of a series of constant values, with a different constant value for each realisation.
A law of large numbers does not apply on this case, as the limiting value of an average from a single realisation takes the random value determined by , rather than taking the expected value of . The time average of X_t does not converge since the process is not ergodic. X_t=\cos (t+Y) \quad \text{ for } t \in \mathbb{R}.
Then \left\{X_t\right\} is strictly stationary since ( modulo ) follows the same uniform distribution as Y for any . z_t=\cos(t\omega) \quad (t=1,2,...) Then \begin{align} \mathbb{E}(z_t) &= \frac{1}{2\pi} \int_0^{2\pi} \cos(t\omega) \,d\omega = 0,\\ \operatorname{Var}(z_t) &= \frac{1}{2\pi} \int_0^{2\pi} \cos^2(t\omega) \,d\omega = 1/2,\\ \operatorname{Cov}(z_t , z_j) &= \frac{1}{2\pi} \int_0^{2\pi} \cos(t\omega)\cos(j\omega) \,d\omega = 0 \quad \forall t\neq j. \end{align} So \{z_t\} is a white noise in the weak sense (the mean and cross-covariances are zero, and the variances are all the same), however it is not strictly stationary.
R_X(t_1,t_2) = R_X(t_1-t_2,0) \triangleq R_X(\tau). The third property says that the second moments must be finite for any time . X_t = \int e^{- 2 \pi i \lambda \cdot t} \, d \omega_\lambda, where the integral on the right-hand side is interpreted in a suitable (Riemann) sense. The same result holds for a discrete-time stationary process, with the spectral measure now defined on the unit circle. When processing WSS random signals with linear, time-invariant (LTI) filters, it is helpful to think of the correlation function as a linear operator.
Since it is a circulant operator (depends only on the difference between the two arguments), its eigenfunctions are the Fourier complex exponentials. Additionally, since the eigenfunctions of LTI operators are also complex exponentials, LTI processing of WSS random signals is highly tractable—all computations can be performed in the frequency domain. Thus, the WSS assumption is widely employed in signal processing algorithms.
In the case where \left\{X_t\right\} is a complex stochastic process the autocovariance function is defined as K_{XX}(t_1, t_2) = \operatorname E[(X_{t_1}-m_X(t_1))\overline{(X_{t_2}-m_X(t_2))}] and, in addition to the requirements in , it is required that the pseudo-autocovariance function J_{XX}(t_1, t_2) = \operatorname E[(X_{t_1}-m_X(t_1))(X_{t_2}-m_X(t_2))] depends only on the time lag.
In formulas, \left\{X_t\right\} is WSS, if Two stochastic processes \left\{X_t\right\} and \left\{Y_t\right\} are called jointly wide-sense stationary if they are both wide-sense stationary and their cross-covariance function K_{XY}(t_1, t_2) = \operatorname E[(X_{t_1}-m_X(t_1))(Y_{t_2}-m_Y(t_2))] depends only on the time difference . This may be summarized as follows:
Text derived from https://en.wikipedia.org/w/index.php?oldid=1372425643 under CC BY-SA 4.0; modifications have been made.