You are here: Project Scarlet » Statistical Inference » Linear Regression » OLS Intercept Estimate
OLS Regression
In linear regression, we are modeling the dependent variable using this model:
Y = β0 + β1X + ε
Here, Y is the dependent variable, X is the independent variable, β0 is the expected value of Y when X = 0 in the population, β1 is the effect of X on Y in the population, and ε is random variation unexplained by the model.
To perform statistical inference, we make the usual assumption that
ε ~ Normal(0, σ²)
The y-intercept is the estimate of Y when X = 0. It is the β0 in the model above. There are different methods for estimating this value. Ordinary least squares is one method. Its strengths are that it is easy to perform, it is exact, and that it is straight forward to create the estimators.
Example #711: Let us examine the relationship between the thickness of the leaf on its weight. Let us specifically estimate the weight when the thickness is zero. To explore this, we collect data. The data consist of two measurements on each unit (leaf): thickness and weight. Thus, our data are
Leaf Number | Thickness [μm] | Weight [g] |
---|---|---|
1 | 5.5 | 0.9 |
2 | 4.9 | 1.1 |
3 | 6.8 | 0.7 |
4 | 5.2 | 0.8 |
5 | 5.7 | 3 |
6 | 7 | -1.7 |
7 | 3.6 | 3.5 |
8 | 6.2 | 0.1 |
9 | 4.4 | 2.7 |
10 | 5.9 | 1.2 |
With this information, estimate the value of leaf weight when leaf thickness is zero.
Note: This analysis will not make sense. Leaf thickness is never zero. More importantly, none of the values of the leaf thickness are close to zero. When it is the case that the range of the x-variable does not cover the value zero, the y-intercept should not be examined. To do so would require extrapolation.
To summarize the above, the values of import are:
\( \bar{x} \) | = | 5.52 |
---|---|---|
\( \bar{y} \) | = | 1.23 |
\( b_1 \) | = | -1.1374 |
Note that \( b_1 \) is important in estimating the y-intercept. If you are unsure how to calculate it, or if you would like more practice doing so, please see the OLS estimate of the slope tutorial.
In the box below, please enter the OLS estimate of the y-intercept, then click on the “Check your answer!” button. Please round your answer to the ten-thousandths place.
Show Formula
Show Solution
Show the R Code
© Ole J. Forsberg, Ph.D. 2024. All rights reserved. | . | |