Correlation
Correlation measures linear relationships but does not imply causation.
Correlation is a statistical concept that measures the extent to which two random variables or bivariate data are linearly related. It is a fundamental tool in statistics, often used to indicate predictive relationships, though it does not imply causation. The presence of a correlation alone is insufficient to infer a causal relationship, a principle commonly summarized as "correlation does not imply causation." Furthermore, correlation is not synonymous with dependence; while independent variables are always uncorrelated, uncorrelated variables are not necessarily independent, as they may still be dependent in a nonlinear fashion.
The most common measure is the Pearson product-moment correlation coefficient, developed by Karl Pearson from an idea by Francis Galton. This coefficient is calculated as the ratio of the covariance of two variables to the product of their standard deviations. It attempts to establish a line of best fit through a dataset, indicating how far the actual data deviates from expected values. The resulting value ranges from −1 to +1, where +1 indicates a perfect direct linear relationship, −1 a perfect inverse linear relationship, and values near zero indicate a weaker linear relationship. The coefficient is defined only when both standard deviations are finite and positive.
Because the Pearson coefficient detects only linear dependencies, a correlation of zero does not imply that variables are independent. For instance, if a variable is symmetrically distributed about zero and another is its square, they are perfectly dependent yet uncorrelated. However, in the special case of jointly normal variables, uncorrelatedness does imply independence. Other correlation coefficients have been developed to be more robust than Pearson’s or to detect less structured relationships. The concept has also been generalized to other forms of association, such as mutual information and distance covariance.
- field
- Statistics
- known_for
- Pearson product-moment correlation coefficient
- coefficient_range
- -1 to +1
- common_notation
- ρ or r
Lore & Background
The concept of correlation is central to statistics, describing the degree to which two variables are linearly related. The most common measure is the Pearson product-moment correlation coefficient, developed by Karl Pearson from an idea by Francis Galton. This coefficient is calculated as the ratio of covariance to the product of standard deviations, yielding a value between -1 and +1. A value of +1 indicates a perfect positive linear relationship, -1 a perfect negative linear relationship, and 0 no linear relationship. However, correlation is not the same as dependence: uncorrelated variables may still be dependent. The presence of correlation alone is insufficient to infer causation, a principle often summarized as 'correlation does not imply causation.' Other coefficients, such as Spearman's rank correlation coefficient, are more robust and detect less structured relationships. The concept has been generalized to mutual information and distance covariance.
Reader's Guide
Correlation is a foundational concept in statistics, used to quantify the strength and direction of a linear relationship between two variables. Its primary significance lies in its ability to indicate predictive relationships, as seen in practical applications like an electrical utility adjusting power production based on weather-correlated demand. However, its limitations are critical: correlation does not imply causation, and uncorrelated variables may still be dependent. The Pearson correlation coefficient, the most common variant, is sensitive only to linear relationships, while other coefficients like Spearman's rank correlation address nonlinear associations. The coefficient ranges from -1 to +1, with values near zero indicating weaker linear dependence. Despite its widespread use, correlation must be interpreted cautiously, as it does not establish cause-and-effect. Its legacy includes informing fields from economics to medicine, where it helps identify associations but requires further analysis to confirm causality. The development of alternative measures, such as mutual information, reflects ongoing efforts to capture more complex dependencies.
Did You Know?
- The Pearson correlation coefficient is defined only if both standard deviations are finite and positive.
- The absolute value of the Pearson correlation coefficient is not bigger than 1, as a corollary of the Cauchy–Schwarz inequality.
- Correlation is not the same as dependence: uncorrelated variables may still be dependent.
- The concept of correlation has been generalized to mutual information and distance covariance.
More in Probability And Stochastic Processes 1-21
Spotted an error? Know more?
This is a living reference — every entry is fact-audited, and reader corrections feed straight into our audit queue. Suggest an edit · See this site's audit record