Multiple regression analysis: Difference between revisions

From CEOpedia | Management online
m (→‎References: typos fixed: Supliment → Supplement)
 
mNo edit summary
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{infobox4
|list1=
<ul>
<li>[[Adjusted mean]]</li>
<li>[[Three-Way ANOVA]]</li>
<li>[[Selection process in conditions of certainty and uncertainty]]</li>
<li>[[Interval scale]]</li>
<li>[[Monte carlo method]]</li>
<li>[[Cronbach Alpha]]</li>
<li>[[Parametric analysis]]</li>
<li>[[Risks and uncertainties]]</li>
<li>[[Osma]]</li>
</ul>
}}
'''Multiple regression analysis''' is a [[method]] of valuing connection between two or more independent and one dependent variables<ref>Lefter C. 2004, p. 364</ref>.  
'''Multiple regression analysis''' is a [[method]] of valuing connection between two or more independent and one dependent variables<ref>Lefter C. 2004, p. 364</ref>.  


The most common model used in '''multiple regression analysis''' is linear regression model. In mathematical terms, performing regression analysis of this model is finding "coefficient of multiple correlation (R) that
The most common model used in '''multiple regression analysis''' is linear regression model. In mathematical terms, performing regression analysis of this model is finding "coefficient of multiple correlation (R) that
defines the amount of linear correlation in between the dependent variable y and the independent variables <math>x_1, x_2,…x_n</math>"<ref>Shyti B., Isa I., Paralloi S. 2017, p. 301</ref>.
defines the amount of linear correlation in between the dependent variable y and the independent variables <math>x_1, x_2, ... x_n</math>"<ref>Shyti B., Isa I., Paralloi S. 2017, p. 301</ref>.


==Linear multiple regression model==
==Linear multiple regression model==
Relation between dependent variable y and n independent variables <math>x_1, x_2,...x_n</math> can be expressed as linear regression model:
Relation between dependent variable y and n independent variables <math>x_1, x_2,...x_n</math> can be expressed as linear regression model:


<math>y = β_0 + β_1 x_1 + β_2 x_2 + ... + β_n x_n + ε</math>
<math>y = \Beta_0 + \Beta_1 x_1 + \Beta_2 x_2 + ... + \Beta_n x_n + \varepsilon</math>


where <math>ε</math> is residual factor, <math>β_k (k = 0, 1, 2, ..., n)</math> are regression factors (coefficients). <math>β_0</math> is a constant called regression intercept, while <math>β_1, β_2, ...</math> are regression slope parameters <ref>Anghelache C., et al. 2013, p. 134</ref>.
where <math>\varepsilon</math> is residual factor, <math>\Beta_k (k = 0, 1, 2, ..., n)</math> are regression factors (coefficients). <math>\Beta_0</math> is a constant called regression intercept, while <math>\Beta_1, \Beta_2, ...</math> are regression slope parameters <ref>Anghelache C., et al. 2013, p. 134</ref>.


The goal of '''multiple regression analysis''' is finding all factors <math>β_k</math> in above equation.  
The goal of '''multiple regression analysis''' is finding all factors <math>\Beta_k</math> in above equation.  


==Calculating regression coefficients==
==Calculating regression coefficients==
Line 35: Line 21:


==Nonlinear regression==
==Nonlinear regression==
When model is nonlinear, regression must be performed by iterative procedure. Nonlinear regression analysis aims to find best nonlinear function that fits given data set. With two dependents, this function is a curve. To find (nonlinear) coefficients of this model, usually numerical optimization algorithms are used. When dependent value has a constant variance, ordinary least squares method may be used to minimize sum of squared residuals. Otherwise, weighted least squares method that aims to minimize sum of weighted squared residuals.
When model is nonlinear, regression must be performed by iterative procedure. Nonlinear regression analysis aims to find best nonlinear function that fits given data set. With two dependents, this function is a curve. To find (nonlinear) coefficients of this model, usually numerical optimization algorithms are used. When dependent value has a constant variance, ordinary least squares method may be used to minimize sum of squared residuals. Otherwise, weighted least squares method that aims to minimize sum of weighted squared residuals.  


Sometimes, nonlinear models are transformed to linear domain, making analysis linear, thus much easier to perform (as it does not require iterative optimization). This transformation changes influences of data values and distribution of errors in model, so it must be used with caution and preceded with careful data examination <ref>Oosterbaan R.J. 2002, p. 33</ref>.
Sometimes, nonlinear models are transformed to linear domain, making analysis linear, thus much easier to perform (as it does not require iterative optimization). This transformation changes influences of data values and distribution of errors in model, so it must be used with caution and preceded with careful data examination <ref>Oosterbaan R.J. 2002, p. 33</ref>.
{{infobox5|list1={{i5link|a=[[Two-way ANOVA]]}} &mdash; {{i5link|a=[[Sensitivity analysis]]}} &mdash; {{i5link|a=[[Parametric analysis]]}} &mdash; {{i5link|a=[[Adjusted mean]]}} &mdash; {{i5link|a=[[Descriptive statistics]]}} &mdash; {{i5link|a=[[Control chart]]}} &mdash; {{i5link|a=[[Cluster analysis]]}} &mdash; {{i5link|a=[[Box diagram]]}} &mdash; {{i5link|a=[[Histogram]]}} }}


==References==
==References==
* Alma Ö.G. (2011), [https://www.researchgate.net/profile/Oezlem_Gueruenlue_Alma/publication/284946872_Comparison_of_Robust_Regression_Methods_in_Linear_Regression/links/59fcdbfeaca272347a22d659/Comparison-of-Robust-Regression-Methods-in-Linear-Regression.pdf ''Comparison of Robust Regression Methods in Linear Regression''], "International Journal of Contemporary Mathematical Sciences", vol. 6
* Alma Ö.G. (2011), [https://www.researchgate.net/profile/Oezlem_Gueruenlue_Alma/publication/284946872_Comparison_of_Robust_Regression_Methods_in_Linear_Regression/links/59fcdbfeaca272347a22d659/Comparison-of-Robust-Regression-Methods-in-Linear-Regression.pdf ''Comparison of Robust Regression Methods in Linear Regression''], "International Journal of Contemporary Mathematical Sciences", vol. 6
* Anghelache C., et al. (2013), [http://www.revistadestatistica.ro/suplimente/2013/2_2013/srrs2_2013a19.pdf ''Multiple Regression Used in Macro-economic Analysis''], Revista Română de Statistică - Supplement Trim II/2013
* Anghelache C., et al. (2013), [http://www.revistadestatistica.ro/suplimente/2013/2_2013/srrs2_2013a19.pdf ''Multiple Regression Used in Macro-economic Analysis''], Revista Română de Statistică - Supplement Trim II/2013
* Kulcsár E. (2009), [http://www.revistadeturism.ro/index.php/rdt/article/viewFile/106/75 ''Multiple Regression Analysis of Main Economic Indicators in Tourism''], "Revista de turism-studii si cercetari in turism"
* Kulcsár E. (2009), [http://www.revistadeturism.ro/index.php/rdt/article/viewFile/106/75 ''Multiple Regression Analysis of Main Economic Indicators in Tourism''], "Revista de turism-studii si cercetari in turism"
* Lefter C. (2004), ''[[Marketing]] Researches'', Infomarket, Brasov
* Lefter C. (2004), ''[[Marketing]] Researches'', Infomarket, Brasov
* Oosterbaan R.J. (2002), [https://www.waterlog.info/pdf/analysis.pdf ''Drainage research in farmers' fields: analysis of data. Part of project “Liquid Gold” of the International Institute for Land Reclamation and Improvement (ILRI)''], International Institute for Land Reclamation and Improvement, Wageningen
* Oosterbaan R.J. (2002), [https://www.waterlog.info/pdf/analysis.pdf ''Drainage research in farmers' fields: analysis of data. Part of project "Liquid Gold" of the International Institute for Land Reclamation and Improvement (ILRI)''], International Institute for Land Reclamation and Improvement, Wageningen
* Shyti B., Isa I., Paralloi S. (2017), [https://www.mcser.org/journal/index.php/ajis/article/download/9795/9433 ''Multiple Regressions for the Financial Analysis of Alabanian Economy''], "Academic Journal of Interdisciplinary Studies", vol. 5
* Shyti B., Isa I., Paralloi S. (2017), [https://www.mcser.org/journal/index.php/ajis/article/download/9795/9433 ''Multiple Regressions for the Financial Analysis of Alabanian Economy''], "Academic Journal of Interdisciplinary Studies", vol. 5


==Footnotes==
==Footnotes==
<references />
<references />
[[Category:Methods and techniques]]
[[Category:Methods and techniques]]


{{a|Karolina Próchniak}}
{{a|Karolina Próchniak}}

Latest revision as of 08:48, 18 November 2023

Multiple regression analysis is a method of valuing connection between two or more independent and one dependent variables[1].

The most common model used in multiple regression analysis is linear regression model. In mathematical terms, performing regression analysis of this model is finding "coefficient of multiple correlation (R) that defines the amount of linear correlation in between the dependent variable y and the independent variables "[2].

Linear multiple regression model

Relation between dependent variable y and n independent variables can be expressed as linear regression model:

where is residual factor, are regression factors (coefficients). is a constant called regression intercept, while are regression slope parameters [3].

The goal of multiple regression analysis is finding all factors in above equation.

Calculating regression coefficients

In linear models calculating regression coefficients means finding linear function (in case of two dependents - represented by straight line) that fits given data set best. Depending on what "best fit" is described as (in statistics this problem is called goodness of fit), different methods can be used to perform regression.

The most popular method of finding regression coefficients of linear models is ordinary least squares method. It minimizes the sum of squared distances of all of the points from the data set to regression surface. It's popularity derives from effectiveness and ease of calculations[4].

It must be noted that correlations between independent variables of the model are possible (and sometimes they are hard to determine before analysis). To determine connections between them, analysis of dependencies of correlations must be performed. If one correlations between any two variables is high, one of them must be eliminated from model[5].

Nonlinear regression

When model is nonlinear, regression must be performed by iterative procedure. Nonlinear regression analysis aims to find best nonlinear function that fits given data set. With two dependents, this function is a curve. To find (nonlinear) coefficients of this model, usually numerical optimization algorithms are used. When dependent value has a constant variance, ordinary least squares method may be used to minimize sum of squared residuals. Otherwise, weighted least squares method that aims to minimize sum of weighted squared residuals.

Sometimes, nonlinear models are transformed to linear domain, making analysis linear, thus much easier to perform (as it does not require iterative optimization). This transformation changes influences of data values and distribution of errors in model, so it must be used with caution and preceded with careful data examination [6].


Multiple regression analysis — recommended articles
Two-way ANOVA — Sensitivity analysis — Parametric analysis — Adjusted mean — Descriptive statistics — Control chart — Cluster analysis — Box diagram — Histogram

References

Footnotes

  1. ↑ Lefter C. 2004, p. 364
  2. ↑ Shyti B., Isa I., Paralloi S. 2017, p. 301
  3. ↑ Anghelache C., et al. 2013, p. 134
  4. ↑ Alma Ö.G. 2011, p. 409-411
  5. ↑ Kulcsár E. 2009, p. 63
  6. ↑ Oosterbaan R.J. 2002, p. 33

Author: Karolina Próchniak

Retrieved from "https://ceopedia.org/index.php?title=Multiple_regression_analysis&oldid=97638"