Using Projection Formulas Correctly
students, today you will learn how projection formulas help us break a vector into two meaningful parts: one part that points along another vector, and one part that is perpendicular to it. This idea is a major part of inner products and orthogonality because it connects geometry, algebra, and real-world problem solving. π―
Lesson objectives
- Explain the main ideas and terminology behind projection formulas.
- Apply linear algebra reasoning to compute projections correctly.
- Connect projections to orthogonality and inner products.
- Summarize why projections matter in vector spaces.
- Use examples to justify each step of a projection calculation.
By the end of this lesson, students, you should be able to look at two vectors and find the projection of one onto the other, understand what the result means, and avoid common mistakes. These skills are used in physics, computer graphics, data analysis, and engineering. π‘
What a projection means
A projection is like a shadow. Imagine a flashlight shining straight down on a stick. The shadow of the stick on the floor is the part of the stick that lies in the floorβs direction. In linear algebra, the βshadowβ of a vector $\mathbf{u}$ onto a nonzero vector $\mathbf{v}$ is called the projection of $\mathbf{u}$ onto $\mathbf{v}$, written as $\operatorname{proj}_{\mathbf{v}}\mathbf{u}$.
The goal is to find the vector along $\mathbf{v}$ that is closest to $\mathbf{u}$. This projected vector is the best approximation to $\mathbf{u}$ using only direction $\mathbf{v}$. The leftover part is perpendicular to $\mathbf{v}$, which is why orthogonality matters.
The standard projection formula is
$$
\operatorname{proj}_{\mathbf{v}}$\mathbf{u}$=$\frac{\mathbf{u}\cdot\mathbf{v}}{\mathbf{v}\cdot\mathbf{v}}$$\mathbf{v}$
$$
Here, $\mathbf{u}\cdot\mathbf{v}$ is the dot product, and $\mathbf{v}\cdot\mathbf{v}$ is the squared length of $\mathbf{v}$. This formula works only when $\mathbf{v}\neq\mathbf{0}$.
A helpful way to remember the formula is: take the amount of $\mathbf{u}$ in the direction of $\mathbf{v}$, then multiply that amount by $\mathbf{v}$. The dot product measures alignment. If the vectors point in the same direction, the dot product is positive. If they are perpendicular, the dot product is $0$. π
Why the formula works
To understand the formula, students, think of splitting $\mathbf{u}$ into two parts:
$$
$\mathbf{u}=\mathbf{p}+\mathbf{w}$
$$
where $\mathbf{p}$ lies along $\mathbf{v}$ and $\mathbf{w}$ is perpendicular to $\mathbf{v}$. Since $\mathbf{p}$ lies on the line through $\mathbf{v}$, we can write
$$
$\mathbf{p}=c\mathbf{v}$
$$
for some scalar $c$. Then
$$
$\mathbf{u}=c\mathbf{v}+\mathbf{w}$
$$
and because $\mathbf{w}$ is perpendicular to $\mathbf{v}$,
$$
$\mathbf{w}\cdot\mathbf{v}=0.$
$$
Now take the dot product of both sides of $\mathbf{u}=c\mathbf{v}+\mathbf{w}$ with $\mathbf{v}$:
$$
$\mathbf{u}\cdot\mathbf{v}=(c\mathbf{v})\cdot\mathbf{v}+\mathbf{w}\cdot\mathbf{v}$
$$
so
$$
$\mathbf{u}\cdot\mathbf{v}=c(\mathbf{v}\cdot\mathbf{v}).$
$$
Solving for $c$ gives
$$
$ c=\frac{\mathbf{u}\cdot\mathbf{v}}{\mathbf{v}\cdot\mathbf{v}}.$
$$
That is exactly the scale factor in the projection formula. This derivation shows why the projected vector is the part of $\mathbf{u}$ along $\mathbf{v}$ and why the remaining part is orthogonal. π§
A step-by-step example in $\mathbb{R}^2$
Let
$$
$\mathbf{u}$=$\begin{pmatrix}3$\\$4\end{pmatrix}$,\qquad $\mathbf{v}$=$\begin{pmatrix}2$\\$0\end{pmatrix}$.
$$
We want $\operatorname{proj}_{\mathbf{v}}\mathbf{u}$.
First compute the dot products:
$$
$\mathbf{u}\cdot\mathbf{v}=3\cdot2+4\cdot0=6$
$$
and
$$
$\mathbf{v}\cdot\mathbf{v}=2\cdot2+0\cdot0=4.$
$$
Now substitute into the formula:
$$
\operatorname{proj}_{\mathbf{v}}$\mathbf{u}$=$\frac{6}{4}$$\begin{pmatrix}2$\\$0\end{pmatrix}$=$\frac{3}{2}$$\begin{pmatrix}2$\\$0\end{pmatrix}$=$\begin{pmatrix}3$\\$0\end{pmatrix}$.
$$
So the projection is $\begin{pmatrix}3\\0\end{pmatrix}$. This makes sense because $\mathbf{v}$ points along the horizontal axis, so projecting $\mathbf{u}$ onto $\mathbf{v}$ keeps only the horizontal part. The vertical part, $\begin{pmatrix}0\\4\end{pmatrix}$, is orthogonal to $\mathbf{v}$.
Check the decomposition:
$$
$\mathbf{u}=\begin{pmatrix}3\\0\end{pmatrix}+\begin{pmatrix}0\\4\end{pmatrix}.$
$$
The second vector is perpendicular to $\mathbf{v}$ because its dot product with $\mathbf{v}$ is
$$
$\begin{pmatrix}0\\4\end{pmatrix}\cdot\begin{pmatrix}2\\0\end{pmatrix}=0.$
$$
This example shows that projection is not just a formula to memorize. It is a method for separating a vector into parallel and perpendicular parts. π
Common mistakes and how to avoid them
When using projection formulas correctly, students, attention to detail matters.
1. Projecting onto the zero vector
The formula uses $\mathbf{v}\cdot\mathbf{v}$ in the denominator. If $\mathbf{v}=\mathbf{0}$, then
$$
$\mathbf{v}\cdot\mathbf{v}=0,$
$$
and the formula is undefined. So you can only project onto a nonzero vector.
2. Swapping the order of vectors
Be careful: $\operatorname{proj}_{\mathbf{v}}\mathbf{u}$ means project $\mathbf{u}$ onto $\mathbf{v}$. The vector after the subscript is the direction. Swapping the order changes the result. In general,
$$
\operatorname{proj}_{\mathbf{v}}$\mathbf{u}$$\neq$ \operatorname{proj}_{\mathbf{u}}$\mathbf{v}$.
$$
3. Forgetting the final multiplication by $\mathbf{v}$
Some students compute only the scalar
$$
$\frac{\mathbf{u}\cdot\mathbf{v}}{\mathbf{v}\cdot\mathbf{v}}$
$$
and stop there. That scalar is not yet the projection vector. You must multiply by $\mathbf{v}$ to get the vector result.
4. Mixing up projection and length
The projection is a vector, not just a number. The scalar part measures how much of $\mathbf{u}$ points in the direction of $\mathbf{v}$, but the full projection keeps direction too.
5. Rounding too early
If exact values are possible, keep them exact until the end. Early rounding can cause errors, especially in longer problems.
Projection and orthogonality
Projection is closely tied to orthogonality because the difference between a vector and its projection is perpendicular to the vector being projected onto. If
$$
$\mathbf{p}=\operatorname{proj}_{\mathbf{v}}\mathbf{u},$
$$
then
$$
$\mathbf{u}-\mathbf{p}$
$$
is orthogonal to $\mathbf{v}$. We can verify this using the dot product:
$$
($\mathbf{u}$-$\mathbf{p}$)$\cdot$$\mathbf{v}$=$\mathbf{u}$$\cdot$$\mathbf{v}$-$\mathbf{p}$$\cdot$$\mathbf{v}$.
$$
Since
$$
$\mathbf{p}$=$\frac{\mathbf{u}\cdot\mathbf{v}}{\mathbf{v}\cdot\mathbf{v}}$$\mathbf{v}$,
$$
we get
$$
$\mathbf{p}$$\cdot$$\mathbf{v}$=$\frac{\mathbf{u}\cdot\mathbf{v}}{\mathbf{v}\cdot\mathbf{v}}$($\mathbf{v}$$\cdot$$\mathbf{v}$)=$\mathbf{u}$$\cdot$$\mathbf{v}$.
$$
So
$$
$(\mathbf{u}-\mathbf{p})\cdot\mathbf{v}=0.$
$$
This shows the leftover part is orthogonal. That is the reason projections are so useful in inner product spaces: they create right angles naturally. β
A real-world application: least squares thinking
In data science and engineering, projections help find the best approximation when exact answers are impossible. For example, suppose a company uses a simple line to model sales over time, but the data points do not lie perfectly on a line. The best-fit line is often found by using projections in a higher-dimensional setting.
The idea is to project a data vector onto a subspace made from model vectors. The projection gives the closest vector in that subspace. In practical terms, this means the model error is perpendicular to the space of possible predictions. That perpendicular error is important because it shows the approximation is as accurate as possible with the chosen model.
This same idea appears in computer graphics, where a 3D object is projected onto a screen, and in physics, where a force vector is split into components parallel and perpendicular to a surface. In each case, the projection formula helps separate useful information from the rest. π
Conclusion
students, projection formulas are a core tool in inner products and orthogonality because they let us split a vector into a parallel part and a perpendicular part. The formula
$$
\operatorname{proj}_{\mathbf{v}}$\mathbf{u}$=$\frac{\mathbf{u}\cdot\mathbf{v}}{\mathbf{v}\cdot\mathbf{v}}$$\mathbf{v}$
$$
comes from the idea of writing a vector as a sum of a component along $\mathbf{v}$ and a component orthogonal to $\mathbf{v}$. When used correctly, projections help solve geometry problems, understand distances, and build better models in applied mathematics. The key is to remember what each part means, check that the direction vector is nonzero, and verify orthogonality when needed. With practice, projection problems become a natural extension of dot products and vector decomposition. π
Study Notes
- A projection is the vector part of $\mathbf{u}$ that lies along $\mathbf{v}$.
- The projection formula is
$$
\operatorname{proj}_{\mathbf{v}}$\mathbf{u}$=$\frac{\mathbf{u}\cdot\mathbf{v}}{\mathbf{v}\cdot\mathbf{v}}$$\mathbf{v}$.
$$
- The formula is undefined if $\mathbf{v}=\mathbf{0}$.
- The dot product measures alignment between vectors.
- The difference $\mathbf{u}-\operatorname{proj}_{\mathbf{v}}\mathbf{u}$ is orthogonal to $\mathbf{v}$.
- Projection helps decompose vectors into parallel and perpendicular parts.
- Always keep track of the order: project $\mathbf{u}$ onto $\mathbf{v}$, not the other way around.
- Projection is used in best-fit models, physics, and computer graphics.
- Check answers by verifying that the leftover vector has dot product $0$ with $\mathbf{v}$.
