Norms and Angles
students, imagine using math to answer two everyday questions: How long is this vector? and How close is the angle between these two directions? 📏↔️ In linear algebra, these questions are answered with norms and angles, and both come from the idea of an inner product. This lesson will show how these ideas work, why they matter, and how they connect to geometry, physics, computer graphics, and data science.
What is a norm?
A norm is a rule that measures the size or length of a vector. If a vector is $\mathbf{v}$, its norm is written as $\|\mathbf{v}\|$. In many courses, the most common norm is the Euclidean norm, which behaves like the usual distance you already know from geometry.
For a vector in $\mathbb{R}^n$, $\mathbf{v} = (v_1, v_2, \dots, v_n)$, the Euclidean norm is
$$\|\mathbf{v}\| = \sqrt{v_1^2 + v_2^2 + \cdots + v_n^2}.$$
This is the same idea as the Pythagorean theorem. For example, if $\mathbf{v} = (3,4)$, then
$$\|\mathbf{v}\| = \sqrt{3^2 + 4^2} = 5.$$
So the vector $(3,4)$ can represent a move of 3 units right and 4 units up, and its norm is the length of that move.
A norm is not just any size measure. It must satisfy three important properties:
- Nonnegativity: $\|\mathbf{v}\| \ge 0$ for every vector $\mathbf{v}$, and $\|\mathbf{v}\| = 0$ only when $\mathbf{v} = \mathbf{0}$.
- Scaling: $\|c\mathbf{v}\| = |c|\,\|\mathbf{v}\|$ for any scalar $c$.
- Triangle inequality: $\|\mathbf{u}+\mathbf{v}\| \le \|\mathbf{u}\| + \|\mathbf{v}\|$.
These properties match common sense. If you double a vector, its length doubles. And if you walk along two vector directions one after the other, the straight-line distance is never more than the total path length. 🚶♂️
Inner products and the idea of angle
To talk about angles between vectors, we need an inner product. In $\mathbb{R}^n$, the standard inner product of $\mathbf{u} = (u_1,u_2,\dots,u_n)$ and $\mathbf{v} = (v_1,v_2,\dots,v_n)$ is
$$\mathbf{u} \cdot \mathbf{v} = u_1v_1 + u_2v_2 + \cdots + u_nv_n.$$
This formula connects directly to geometry. The dot product tells us how much one vector points in the direction of another.
A key relationship links inner products, norms, and angles:
$$\mathbf{u} \cdot \mathbf{v} = \|\mathbf{u}\|\,\|\mathbf{v}\|\cos\theta,$$
where $\theta$ is the angle between $\mathbf{u}$ and $\mathbf{v}$. From this formula, we can solve for the angle:
$$\cos\theta = \frac{\mathbf{u} \cdot \mathbf{v}}{\|\mathbf{u}\|\,\|\mathbf{v}\|}.$$
Then
$$\theta = \cos^{-1}\!\left(\frac{\mathbf{u} \cdot \mathbf{v}}{\|\mathbf{u}\|\,\|\mathbf{v}\|}\right).$$
This formula works when both vectors are nonzero. It gives an angle between $0$ and $\pi$ radians, or between $0^\circ$ and $180^\circ$.
Example: finding an angle
Let $\mathbf{u} = (1,2)$ and $\mathbf{v} = (2,1)$. First compute the inner product:
$$\mathbf{u} \cdot \mathbf{v} = (1)(2) + (2)(1) = 4.$$
Now compute the norms:
$$\|\mathbf{u}\| = \sqrt{1^2 + 2^2} = \sqrt{5}, \qquad \|\mathbf{v}\| = \sqrt{2^2 + 1^2} = \sqrt{5}.$$
So
$$\cos\theta = \frac{4}{\sqrt{5}\sqrt{5}} = \frac{4}{5}.$$
Thus,
$$\theta = \cos^{-1}\!\left(\frac{4}{5}\right).$$
This angle is less than $90^\circ$, so the vectors point in broadly similar directions. 🔎
Orthogonality: when vectors meet at right angles
Two vectors are orthogonal if their angle is $90^\circ$, which means they are perpendicular. In inner product language, this happens exactly when their inner product is zero:
$$\mathbf{u} \cdot \mathbf{v} = 0 \iff \mathbf{u} \text{ and } \mathbf{v} \text{ are orthogonal}.$$
This is one of the most useful facts in linear algebra.
Example: checking orthogonality
Let $\mathbf{a} = (2,-1)$ and $\mathbf{b} = (1,2)$. Then
$$\mathbf{a} \cdot \mathbf{b} = (2)(1) + (-1)(2) = 2 - 2 = 0.$$
So $\mathbf{a}$ and $\mathbf{b}$ are orthogonal.
Think of a city map with streets at right angles. If one vector points east and another points north, they are orthogonal. Orthogonality is useful because it lets us break complicated vectors into simpler, independent parts. 🏙️
Orthogonal vectors are especially important in data and computation because they behave like completely separate directions. When vectors are orthogonal, their dot product being zero means they do not overlap in the inner-product sense.
How norms and angles fit together
The relationship between norms and angles is not separate from inner products; it is built from them. The dot product gives both length information and direction information. If $\mathbf{u}$ and $\mathbf{v}$ are the same direction, then $\theta = 0$ and $\cos\theta = 1$, so the dot product is as large as possible relative to the sizes of the vectors. If they are opposite, then $\theta = \pi$ and $\cos\theta = -1$, so the dot product is negative. If they are orthogonal, then $\theta = \frac{\pi}{2}$ and $\cos\theta = 0$, so the dot product is zero.
This means the inner product tells us whether vectors are pointing together, apart, or sideways relative to each other.
A very important identity connects the norm to the inner product:
$$\|\mathbf{v}\| = \sqrt{\mathbf{v} \cdot \mathbf{v}}.$$
This works because
$$\mathbf{v} \cdot \mathbf{v} = v_1^2 + v_2^2 + \cdots + v_n^2.$$
So norms can be built from inner products. In fact, in many vector spaces, an inner product is what creates the norm used in that space.
Real-world interpretation
Suppose a robot moves in two steps represented by vectors $\mathbf{u}$ and $\mathbf{v}$. If $\mathbf{u}$ and $\mathbf{v}$ are orthogonal, their paths are independent directions, like moving forward and then turning left. The norm of the resulting vector gives the total straight-line displacement. The angle tells how sharply the robot changed direction. This is one reason engineers and computer scientists use norms and angles constantly. 🤖
Why these ideas matter in practice
Norms and angles are not just classroom ideas. They are used in many fields:
- In physics, force vectors are compared using angles, and lengths of vectors can represent magnitude.
- In computer graphics, lighting and shading depend on angles between surface normals and light directions.
- In machine learning, vectors may represent data points, and similarity is often measured using angles or inner products.
- In navigation, direction and distance are both vector-based.
For example, in graphics, if a light source hits a surface head-on, the angle between the light direction and the surface normal is small, so the surface appears brighter. If the angle is $90^\circ$, the light grazes the surface and the brightness decreases. This is a geometric use of the same formula students just learned.
Norms also help measure error. If $\mathbf{e}$ is an error vector, then $\|\mathbf{e}\|$ tells how far a prediction is from the true value. A smaller norm means a more accurate result.
Conclusion
Norms and angles are two sides of the same geometric idea. A norm measures the size of a vector, while an angle describes how two vectors point relative to each other. Inner products connect them through formulas like $\mathbf{u} \cdot \mathbf{v} = \|\mathbf{u}\|\,\|\mathbf{v}\|\cos\theta$. Orthogonality appears when the inner product is zero, which means vectors meet at a right angle. Together, these ideas form a core part of Inner Products and Orthogonality in linear algebra and give powerful tools for geometry, science, and technology.
Study Notes
- A norm measures vector length; the Euclidean norm is $\|\mathbf{v}\| = \sqrt{v_1^2 + v_2^2 + \cdots + v_n^2}$.
- A norm must satisfy nonnegativity, scaling, and the triangle inequality.
- The standard inner product in $\mathbb{R}^n$ is $\mathbf{u} \cdot \mathbf{v} = u_1v_1 + u_2v_2 + \cdots + u_nv_n$.
- The angle between nonzero vectors is found using $\cos\theta = \frac{\mathbf{u} \cdot \mathbf{v}}{\|\mathbf{u}\|\,\|\mathbf{v}\|}$.
- Two vectors are orthogonal exactly when $\mathbf{u} \cdot \mathbf{v} = 0$.
- The norm can be computed from the inner product using $\|\mathbf{v}\| = \sqrt{\mathbf{v} \cdot \mathbf{v}}$.
- Norms and angles help describe distance, direction, similarity, and error in many real-world applications.
- Understanding norms and angles is a major step in mastering Inner Products and Orthogonality.