Regression analysis
Last updated
Regression is used for prediction and forecasting, and sometimes to infer causal relationships.[1] In statistical modeling, regression analysis is a method for estimating how a dependent variable relates to one or more independent variables.[2] Linear regression, the most prevalent type, identifies the line or linear combination that best matches the data based on a defined mathematical criterion.[3]
Quick Facts
- Field
- Statistics
Facts from the source article.
Key facts and history
The earliest form of regression was seen in Isaac Newton's 1700 work on equinoxes, which introduced an embryonic linear regression analysis.[4] Udny Yule and Karl Pearson later extended Galton's work to a more general statistical context.[5] R.A. Fisher weakened the assumption of a Gaussian joint distribution in his works of 1922 and 1925.[6] Legendre in 1805 and Gauss in 1809 each published the least squares method, using it to find orbits of comets and minor planets around the Sun.[7]
A version of the Gauss–Markov theorem appeared in Gauss's 1821 publication, which further developed least squares theory.[8] Electromechanical desk calculators were the tools economists used for regression calculations during the 1950s and 1960s.[9] Getting results from a single regression before 1970 could require as long as 24 hours.[9]
What the research sources say
Necessary Condition Analysis is an approach that can complement regression-based methods in social, medical, and technical sciences.[10] Under the Gauss–Markov assumptions, least-squares estimators are unbiased, consistent, and efficient among linear unbiased estimators.[11][12] Because classical assumptions rarely hold exactly in practice, various methods have been created to preserve these desirable estimator properties.[11][12] When error variance changes across values of independent variables, heteroscedasticity-consistent standard errors can be used.[11][12]
Clustered standard errors and geographically weighted regression are techniques for handling correlated errors within data subsets.[11][12]
References
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: David A. Freedman, "Statistical Models: Theory and Practice", Cambridge University Press, 27 April 2009; R. Dennis Cook; Sanford Weisberg Criticism and Influence Analysis in Regression, Sociological Methodology, Vol. 13. (1982), pp. 313–361 (original not read by us) en.wikipedia.org
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: Yan, "Linear Regression Analysis: Theory and Computing", World Scientific Publishing, 2009, p. 2–3; Freund, "Statistical Methods", Elsevier Science, 2010, p. 323 (original not read by us) en.wikipedia.org
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: Necessary Condition Analysis (we also read that source) en.wikipedia.org
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: Belenkiy, "Groping Toward Linear Regression Analysis: Newton's Analysis of Hipparchus' Equinox Observations", 2008; Buchwald, "Newton and the Origin of Civilization", Princeton University Press, 2013, p. 90–93, 101–103 (we also read that source) en.wikipedia.org
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: Mogull, "Second-Semester Applied Statistics", Kendall/Hunt Publishing Company, 2004, p. 59; Galton, "Kinship and Correlation (reprinted 1989)", Statistical Science, 1989, p. 80–86; Francis Galton. "Typical laws of heredity", Nature 15 (1877), 492–495, 512–514, 532–533. (Galton uses the term "reversion" in this paper, which discusses the si; Francis Galton. Presidential address, Section H, Anthropology. (1885) (Galton uses the term "regression" in this paper, which discusses the height of humans.); Yule, "On the Theory of Correlation en.wikipedia.org
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: Fisher, "The goodness of fit of regression formulae, and the distribution of regression coefficients", Journal of the Royal Statistical Society, 1922, p. 597–612; Ronald A. Fisher, "Statistical Methods for Research Workers", Oliver and Boyd, 1970; Aldrich, "Fisher and Regression", Statistical Science, 2005, p. 401–417 (original not read by us) en.wikipedia.org
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: A.M. Legendre. Nouvelles méthodes pour la détermination des orbites des comètes, Firmin Didot, Paris, 1805. "Sur la Méthode des moindres quarrés" appears as an ; Chapter 1 of: Angrist, J. D., & Pischke, J. S. (2008). Mostly Harmless Econometrics: An Empiricist's Companion. Princeton University Press. (original not read by us) en.wikipedia.org
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: "Theoria combinationis observationum erroribus minimis obnoxiae", 1821–1823 (original not read by us) en.wikipedia.org
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: Rodney Ramcharan. Regressions: Why Are Economists Obessessed with Them? March 2006. Accessed 2011-12-03. (original not read by us) en.wikipedia.org
- Necessary Condition Analysis. facts only, no text reused. erim.eur.nl
- Wikipedia, "Regression analysis" (CC BY-SA 4.0), which cites: Fotheringham, "Geographically weighted regression: the analysis of spatially varying relationships", John Wiley, 2002; Fotheringham, "The modifiable areal unit problem in multivariate statistical analysis", Environment and Planning A, 1 January 1991, p. 1025–1044 (we also read that source) en.wikipedia.org
- Open Library record, ISBN 9780471496168 ("Geographically weighted regression"). CC0 (metadata); book content not read. openlibrary.org
Each numbered sentence above was checked against the source it cites before publication. Sentences citing Wikipedia adapt text from the English Wikipedia article Regression analysis (contributors), used under CC BY-SA 4.0; this entry is available under the same licence. Other sources were used for facts only; no text or images are copied from them.
More in Probability & Statistics
Sources
Compiled from Wikipedia and the sources listed below. Text from Wikipedia is available under CC BY-SA 4.0; this entry is adapted from it.
- Wikipedia: Regression analysis (CC BY-SA 4.0).
- Word definitions: the Codexery glossary, each quoted from its Wikipedia article.
Spotted an error? Know more?
Reader corrections go straight into our review queue. Suggest an edit · How this site is sourced