6. Vectors in Euclidean Space

Orthogonality

Orthogonality in Euclidean Space

students, imagine two arrows on a map that meet at a perfect corner, like the edges of a square 📐. That corner is the heart of orthogonality. In Linear Algebra, orthogonality is the idea that two vectors are perpendicular, meaning they meet at a $90^\circ$ angle. This lesson will show you how to recognize orthogonality, test it using the dot product, and understand why it matters in geometry, physics, computer graphics, and data analysis.

What Orthogonality Means

In Euclidean space, vectors are often drawn as arrows from the origin to points in space. Two nonzero vectors are orthogonal if the angle between them is $90^\circ$. In everyday language, they are “perpendicular.” This idea works in $\mathbb{R}^2$, $\mathbb{R}^3$, and higher-dimensional spaces too.

The most important test for orthogonality is the dot product. For vectors $\mathbf{u}$ and $\mathbf{v}$, if

$$\mathbf{u} \cdot \mathbf{v} = 0,$$

then the vectors are orthogonal, provided both are ordinary vectors in Euclidean space. This is one of the most useful facts in Linear Algebra because it turns a geometric idea into a calculation.

Why does this work? The dot product measures how much one vector points in the direction of another. If the result is $0$, then neither vector points along the other at all. That means the vectors form a right angle.

Example: let $\mathbf{u} = \langle 2, 1 \rangle$ and $\mathbf{v} = \langle 1, -2 \rangle$. Then

$$\mathbf{u} \cdot \mathbf{v} = (2)(1) + (1)(-2) = 2 - 2 = 0.$$

So $\mathbf{u}$ and $\mathbf{v}$ are orthogonal. If you sketch them, you will see they meet at a right angle ✨.

The Dot Product as a Tool

The dot product is defined for vectors in $\mathbb{R}^n$ by multiplying corresponding entries and adding the results. For

$$\mathbf{u} = \langle u_1, u_2, \dots, u_n \rangle$$

and

$$\mathbf{v} = \langle v_1, v_2, \dots, v_n \rangle,$$

the dot product is

$$\mathbf{u} \cdot \mathbf{v} = u_1 v_1 + u_2 v_2 + \cdots + u_n v_n.$$

There is also a geometric formula:

$$\mathbf{u} \cdot \mathbf{v} = \|\mathbf{u}\|\,\|\mathbf{v}\|\cos\theta,$$

where $\theta$ is the angle between the vectors and $\|\mathbf{u}\|$ means the length of $\mathbf{u}$. This formula explains orthogonality immediately. If $\theta = 90^\circ$, then $\cos\theta = 0$, so the dot product is $0$.

This connection between algebra and geometry is one of the central ideas in the course. You can use coordinates to detect angles without measuring them directly.

Example: suppose $\mathbf{u} = \langle 3, 4 \rangle$ and $\mathbf{v} = \langle -4, 3 \rangle$. Then

$$\mathbf{u} \cdot \mathbf{v} = (3)(-4) + (4)(3) = -12 + 12 = 0.$$

These vectors are orthogonal. Notice something interesting: both vectors have length $5$, but they point in different directions. Orthogonality is about direction, not about length.

Orthogonal Vectors and Their Properties

Orthogonality has several important consequences.

First, orthogonal vectors are automatically linearly independent, as long as neither vector is the zero vector. That means one vector cannot be made from a scalar multiple of the other. This makes sense because a vector cannot be both parallel and perpendicular to another nonzero vector.

Second, orthogonal vectors make calculations easier. In many problems, especially those involving projections or decompositions, perpendicular pieces are simpler to work with than angled ones. Think of a bookshelf 📚: the vertical side and horizontal shelf meet at a right angle, making the structure stable and easy to measure.

Third, the zero vector is orthogonal to every vector because

$$\mathbf{0} \cdot \mathbf{v} = 0$$

for every vector $\mathbf{v}$. However, the zero vector is a special case and is usually not counted as part of an orthogonal set when discussing directions, since it has no direction.

A useful warning: two vectors can have a dot product of $0$ only if the space uses the standard Euclidean dot product. In a different inner product, the meaning of orthogonality may change. In this lesson, we stay with Euclidean space and the standard dot product.

Orthogonal Sets and Why They Matter

A set of vectors is called orthogonal if every pair of different vectors in the set is orthogonal. For example, in $\mathbb{R}^3$, the vectors

$$\mathbf{e}_1 = \langle 1, 0, 0 \rangle, \quad \mathbf{e}_2 = \langle 0, 1, 0 \rangle, \quad \mathbf{e}_3 = \langle 0, 0, 1 \rangle$$

are mutually orthogonal because each dot product between different pairs is $0$.

These vectors are the standard basis vectors. They show how a three-dimensional space can be built from perpendicular directions. Moving along the $x$-, $y$-, and $z$-axes is like moving in three independent directions.

Orthogonal sets are useful because they simplify many computations. If vectors are orthogonal, it is easier to find coordinates, lengths, and angles. They also help us describe shapes and spaces more cleanly.

If each vector in an orthogonal set is also a unit vector, meaning its length is $1$, then the set is called orthonormal. For instance, the standard basis vectors above are orthonormal because

$$\|\mathbf{e}_1\| = \|\mathbf{e}_2\| = \|\mathbf{e}_3\| = 1.$$

Orthogonality is the “right angle” part, and normalization is the “length $1$” part. Together they create a very efficient coordinate system.

How to Test Orthogonality Step by Step

When students is given two vectors and asked whether they are orthogonal, follow a simple procedure:

  1. Write the vectors in coordinate form.
  2. Compute the dot product.
  3. Check whether the result is $0$.
  4. If it is $0$, the vectors are orthogonal; if not, they are not orthogonal.

Example: are $\mathbf{a} = \langle 1, 2, 3 \rangle$ and $\mathbf{b} = \langle 2, -1, 0 \rangle$ orthogonal?

Compute:

$$\mathbf{a} \cdot \mathbf{b} = (1)(2) + (2)(-1) + (3)(0) = 2 - 2 + 0 = 0.$$

So the answer is yes. These vectors are orthogonal.

Now compare with $\mathbf{c} = \langle 1, 1, 1 \rangle$:

$$\mathbf{a} \cdot \mathbf{c} = (1)(1) + (2)(1) + (3)(1) = 6.$$

Since the dot product is not $0$, $\mathbf{a}$ and $\mathbf{c}$ are not orthogonal.

A common mistake is to think that vectors with similar-looking coordinates must be orthogonal or not orthogonal by appearance alone. The only reliable test is the dot product.

Geometry, Projections, and Real-World Meaning

Orthogonality is not just a classroom idea. It shows up in real situations all the time.

In engineering, perpendicular parts of a structure help distribute force safely. In computer graphics, perpendicular vectors are used to model surfaces, shadows, and camera directions. In physics, forces are often broken into perpendicular components, such as horizontal and vertical parts.

A related concept is projection. If you want to split a vector into a part along another vector and a part orthogonal to it, orthogonality becomes essential. The perpendicular part is the leftover piece after removing the projection.

For example, if $\mathbf{u}$ is a vector and $\mathbf{v}$ is a nonzero vector, the projection of $\mathbf{u}$ onto $\mathbf{v}$ is

$$\operatorname{proj}_{\mathbf{v}} \mathbf{u} = \frac{\mathbf{u} \cdot \mathbf{v}}{\mathbf{v} \cdot \mathbf{v}}\mathbf{v}.$$

This formula depends on the dot product. If $\mathbf{u}$ is orthogonal to $\mathbf{v}$, then $\mathbf{u} \cdot \mathbf{v} = 0$, and the projection becomes the zero vector. That means there is no component of $\mathbf{u}$ in the direction of $\mathbf{v}$.

Picture shining a flashlight straight onto a wall. The shadow shows a projection. Orthogonality tells you when a vector points completely away from the direction you are measuring 🌟.

Conclusion

Orthogonality is a foundational idea in Vectors in Euclidean Space. It means two vectors meet at a right angle, and the dot product gives a fast and reliable way to test it. Orthogonal vectors and sets make geometry cleaner, computations easier, and many later topics in Linear Algebra possible. students, if you remember one thing, remember this: in Euclidean space, $\mathbf{u}$ and $\mathbf{v}$ are orthogonal exactly when $\mathbf{u} \cdot \mathbf{v} = 0$.

Study Notes

  • Orthogonality means perpendicularity, or a $90^\circ$ angle, between vectors.
  • The standard test for orthogonality in Euclidean space is $\mathbf{u} \cdot \mathbf{v} = 0$.
  • For $\mathbf{u} = \langle u_1, \dots, u_n \rangle$ and $\mathbf{v} = \langle v_1, \dots, v_n \rangle$, the dot product is $\mathbf{u} \cdot \mathbf{v} = u_1 v_1 + \cdots + u_n v_n$.
  • The geometric formula is $\mathbf{u} \cdot \mathbf{v} = \|\mathbf{u}\|\,\|\mathbf{v}\|\cos\theta$.
  • If $\theta = 90^\circ$, then $\cos\theta = 0$, so the vectors are orthogonal.
  • A set is orthogonal if every pair of different vectors in the set is orthogonal.
  • If an orthogonal set also has vectors of length $1$, it is orthonormal.
  • The zero vector is orthogonal to every vector, since $\mathbf{0} \cdot \mathbf{v} = 0$.
  • Orthogonality helps with projections, coordinate systems, and simplifying calculations.
  • In applications, orthogonality appears in engineering, physics, and computer graphics.

Practice Quiz

5 questions to test your understanding