Lesson 17
The Gauss-Markov Theorem
Big question
What does it mean that OLS is BLUE?
Lesson progress
Complete checkpoints as you learn
Learning objectives
- Explain the gauss-markov theorem in plain language.
- Use multiple regression correctly in an interpretation.
- Connect the lesson idea to a formula, graph, Python result, or real example.
Simple explanation
Under MLR.1 through MLR.5, OLS is the Best Linear Unbiased Estimator, meaning it has the smallest variance among linear unbiased estimators.
Key terms
- multiple regression
- A regression model with one outcome and two or more explanatory variables.
- residual
- The sample prediction error y minus fitted y.
- omitted-variable bias
- Bias that can arise when a relevant omitted factor is related to an included regressor.
Core formula
Use plain-language interpretation before algebra.
Example
Best does not mean perfect in one sample. It means most precise within a defined class of estimators under the assumptions.
Interactive visual
Repeated-sampling BLUE simulation
Original Module 3 visual for The Gauss-Markov Theorem.
y variable
wage
The dependent variable. It is the outcome students want to explain.
x variable
education
The explanatory variable. It is used to describe changes in wage.
Live Python
The Gauss-Markov Theorem Python example
The Gauss-Markov Theorem Python example
Stdout
Run Python to see results here.
Status / stderr
Ready to run Python in your browser.
Line-by-line guide
- Line 1Load a Python library needed for data work or regression.
- Line 2Load a Python library needed for data work or regression.
- Line 3Load a Python library needed for data work or regression.
- Line 5Load the dataset into a pandas DataFrame.
- Line 6Create a log version of the variable so coefficients can be read approximately as percentages.
- Line 7Add an intercept column to the regression design matrix.
- Line 8Create or update a Python object used in the analysis.
- Line 9Estimate an ordinary least squares regression.
- Line 10Display a result so students can inspect the output.
Python walkthrough
- 1Load the dataset and keep only variables needed for the current model.
- 2Construct the dependent variable and explanatory-variable matrix.
- 3Add a constant so the regression includes an intercept.
- 4Fit OLS and interpret coefficients with the controls held fixed.
Live notebook
Run this lesson as a notebook
Open an editable notebook cell-by-cell, run Python in the browser, and download the `.ipynb` file for later.
Related dataset
WAGE1
Estimated time
25 to 40 min
Packages
pandas, numpy, statsmodels, patsy
Expected output
A regression or inference table with coefficients, uncertainty, and short interpretation notes.
Learning goals
- Load and inspect WAGE1.
- Run the Python cells connected to Multiple Regression in Python.
- Interpret the output using multiple regression and WAGE1.
Common errors
- File not found: check that WAGE1.DTA is installed or use the course data folder.
- Package import error: use the browser notebook first, then download for local Jupyter if your local packages differ.
- Column name error: compare your variable names with the dataset variables listed for this notebook.
Dataset path helper
import pandas as pd
df = pd.read_stata("/data/WAGE1.DTA")
df.head()Interactive activity
BLUERepeatedSamplingSimulation
Repeated sampling and BLUE
Compare unbiased estimators by their repeated-sample spread.
Controlled prediction
Interpretation sentence
Holding experience and tenure fixed, one more year of education changes predicted log wage by about 0.075 in this teaching setup.
Residual sketch
Variable role check
In a wage model with education as the focal x, classify experience.
Repeated sampling
Larger samples tighten estimates. Under the Gauss-Markov assumptions, OLS has the smallest variance among linear unbiased estimators.
Control overlap
VIF: 2.22
SE index: 0.136
Try it yourself
Write one plain-English sentence explaining the main idea from this lesson.
Common mistakes
Check these before you move on.
A regression coefficient describes a pattern unless the assumptions or research design support a causal interpretation.
Quick quiz
What is the safest interpretation focus in The Gauss-Markov Theorem?
Quick quiz
Which interpretation habit is most important in The Gauss-Markov Theorem?
Quick quiz
Why is LAWSCH85 a reasonable practice dataset here?
Key takeaway
The Gauss-Markov Theorem helps turn multiple regression output into a careful ceteris paribus interpretation.