Skip to main content

If I were to design a linear algebra course

Date

17 Nov 2026

Topics
econometrics
mathematics
teaching
I would combine it with regression and PCA.

I have been teaching a first year linear algebra course this period as a tutor. The course is designed very well – probably my favourite linear algebra course (not that I have seen many). The course tries to go into geometry and visualisation from the very beginning, instead of focusing much on the manual calculation of matrix multiplication and such. It has “theorems” and “proofs”, which might sound weird to mention specifically, but I do think putting things formally is a good way to build a “mathematical thinking”. The tutorial questions are also chosen well. They establish a logical link between different ideas and provide some practice to almost all the concepts involved. The textbook is Linear Algebra and Its Applications by David C. Lay, Steven R. Lay and Judi J. McDonald, which I also like very much.

Me loving the course doesn’t mean the students love it too. I soon realised some students might feel about linear algebra like how I felt about it when I first encountered it in my undergraduate years. I didn’t know what this is for, didn’t know why I need to study it, and naturally felt very bored. I am interested in linear algebra now because I have seen all the application that linear algebra can be used for, especially in my own research, so I can appreciate these abstract ideas and the rigorousness of it. I think students should see some of these too. Not just as examples, but as examinable topics so they would actually study.

If I can design a linear algebra course freely, without worrying about how much time it takes or even the size of the programme, I would combine linear algebra with linear regression and PCA. It would be something like this:

Linear algebra Not so linear algebra
Simple linear regression
System of linear equations When there are only two observations
Echelon form
Multiple linear regression
No solution v.s. at least one solution No solution when No. Obs. > No. Var.
Linear combination Predicted values are linear combinations of predictors, with coefficients as weights
Linear independence Linear independence of variables
Matrix algebra
Invertibility Condition for a unique OLS solution
LU-factorisation
Vector space
Column space The space span by the columns of the design matrix
Basis
Vector y is not in Col(X) when No. Obs. > No. Var.
Orthogonality The residual is the shortest distance between y and Col(X), and is orthogonal to Col(X)
Projection Fitted values are the projection of y onto Col(X)
Gram–Schmidt
Eigenvalue decomposition PCA and dimension reduction

It was in an introductory econometrics course that I first saw the geometric interpretation of regressions. It has been dropped from that course a long time ago, and I haven’t seen any other course that does it like that. I reckon there is a place for the geometry of regression to be taught, and it’s not bad if it’s in a linear algebra course.