Eigenvalues and Eigenvectors Basics
Introduction
students, many real engineering systems can be described by matrices đź“Š. When a matrix acts on a vector, it can stretch, shrink, flip, or rotate that vector. In some special cases, though, a vector keeps the same direction after the matrix acts on it. That special vector is called an eigenvector, and the amount it is stretched or shrunk is called the eigenvalue.
In this lesson, you will learn how to identify eigenvalues and eigenvectors, why they matter, and how they connect to the rest of linear algebra. By the end, you should be able to:
- explain the meaning of eigenvalues and eigenvectors,
- find them for simple matrices,
- interpret what they tell us about a system,
- and connect them to matrices, determinants, inverses, and systems of equations.
This topic appears in engineering because many systems have “preferred directions” or “natural modes,” such as vibrations in bridges, electrical circuits, and data patterns in computer models ⚙️.
What Eigenvectors and Eigenvalues Mean
A matrix can be thought of as a machine that transforms vectors. Suppose a matrix $A$ acts on a vector $\mathbf{v}$. In general, the output $A\mathbf{v}$ points in a different direction from $\mathbf{v}$. But if $\mathbf{v}$ is an eigenvector, then the matrix changes only its size, not its direction.
The defining equation is
$$A\mathbf{v} = \lambda \mathbf{v}$$
where:
- $A$ is a square matrix,
- $\mathbf{v}$ is a nonzero vector called an eigenvector,
- $\lambda$ is a scalar called an eigenvalue.
The vector $\mathbf{v}$ must not be the zero vector, because the zero vector always satisfies the equation for any $\lambda$, which would make the idea useless.
Think of a rubber arrow placed on a stretchy sheet. Most directions get pushed somewhere else when the sheet is pulled. But a few directions may simply get longer or shorter without turning. Those special directions are the eigenvectors, and the stretching factor is the eigenvalue ✨.
For example, if $A\mathbf{v} = 3\mathbf{v}$, then $\mathbf{v}$ is an eigenvector and $3$ is its eigenvalue. That means the vector keeps its direction but becomes three times as long.
How to Find Eigenvalues
To find eigenvalues, we start from the equation
$$A\mathbf{v} = \lambda \mathbf{v}$$
and rewrite it as
$$A\mathbf{v} - \lambda \mathbf{v} = \mathbf{0}$$
Since $\lambda \mathbf{v} = \lambda I\mathbf{v}$, where $I$ is the identity matrix, we get
$$\left(A - \lambda I\right)\mathbf{v} = \mathbf{0}$$
This is a homogeneous system of equations. For a nonzero solution $\mathbf{v}$ to exist, the matrix $A - \lambda I$ must be singular. That means its determinant must be zero:
$$\det\left(A - \lambda I\right) = 0$$
This equation is called the characteristic equation. Solving it gives the eigenvalues.
Example 1
Let
$$A = \begin{bmatrix} 2 & 0 \\ 0 & 5 \end{bmatrix}$$
Then
$$A - \lambda I = \begin{bmatrix} 2 - \lambda & 0 \\ 0 & 5 - \lambda \end{bmatrix}$$
So
$$\det\left(A - \lambda I\right) = (2 - \lambda)(5 - \lambda)$$
Set it equal to zero:
$$ (2 - \lambda)(5 - \lambda) = 0 $$
So the eigenvalues are
$$\lambda = 2 \quad \text{and} \quad \lambda = 5$$
This makes sense because a diagonal matrix stretches the $x$-axis direction by $2$ and the $y$-axis direction by $5$.
How to Find Eigenvectors
After finding an eigenvalue $\lambda$, substitute it back into
$$\left(A - \lambda I\right)\mathbf{v} = \mathbf{0}$$
and solve for the nonzero vectors $\mathbf{v}$.
Example 2
Using the same matrix
$$A = \begin{bmatrix} 2 & 0 \\ 0 & 5 \end{bmatrix}$$
For $\lambda = 2$
We compute
$$A - 2I = \begin{bmatrix} 0 & 0 \\ 0 & 3 \end{bmatrix}$$
Let
$$\mathbf{v} = \begin{bmatrix} x \\ y \end{bmatrix}$$
Then
$$\begin{bmatrix} 0 & 0 \\ 0 & 3 \end{bmatrix}\begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}$$
which gives
$$3y = 0 \Rightarrow y = 0$$
So any nonzero vector of the form
$$\begin{bmatrix} x \\ 0 \end{bmatrix}$$
is an eigenvector for $\lambda = 2$. A simple choice is
$$\begin{bmatrix} 1 \\ 0 \end{bmatrix}$$
For $\lambda = 5$
We compute
$$A - 5I = \begin{bmatrix} -3 & 0 \\ 0 & 0 \end{bmatrix}$$
Then
$$\begin{bmatrix} -3 & 0 \\ 0 & 0 \end{bmatrix}\begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}$$
which gives
$$-3x = 0 \Rightarrow x = 0$$
So any nonzero vector of the form
$$\begin{bmatrix} 0 \\ y \end{bmatrix}$$
is an eigenvector for $\lambda = 5$. A simple choice is
$$\begin{bmatrix} 0 \\ 1 \end{bmatrix}$$
This example shows that each eigenvalue may have its own set of eigenvectors, and every nonzero scalar multiple of an eigenvector is also an eigenvector 🌟.
A Slightly Less Simple Example
Not every matrix is diagonal. Many matrices mix coordinates together.
Consider
$$A = \begin{bmatrix} 4 & 1 \\ 2 & 3 \end{bmatrix}$$
To find eigenvalues, compute
$$\det\left(A - \lambda I\right) = \det\begin{bmatrix} 4 - \lambda & 1 \\ 2 & 3 - \lambda \end{bmatrix}$$
So
$$\det\left(A - \lambda I\right) = (4 - \lambda)(3 - \lambda) - 2$$
Expand:
$$\lambda^2 - 7\lambda + 10 = 0$$
Factor:
$$\left(\lambda - 5\right)\left(\lambda - 2\right) = 0$$
So the eigenvalues are
$$\lambda = 5 \quad \text{and} \quad \lambda = 2$$
Now find an eigenvector for $\lambda = 5$.
$$A - 5I = \begin{bmatrix} -1 & 1 \\ 2 & -2 \end{bmatrix}$$
Solve
$$\begin{bmatrix} -1 & 1 \\ 2 & -2 \end{bmatrix}\begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}$$
This gives
$$-x + y = 0 \Rightarrow y = x$$
So one eigenvector is
$$\begin{bmatrix} 1 \\ 1 \end{bmatrix}$$
For $\lambda = 2$:
$$A - 2I = \begin{bmatrix} 2 & 1 \\ 2 & 1 \end{bmatrix}$$
Solve
$$2x + y = 0 \Rightarrow y = -2x$$
So one eigenvector is
$$\begin{bmatrix} 1 \\ -2 \end{bmatrix}$$
This example is important because it shows that eigenvectors are not always aligned with the coordinate axes. They reveal the directions where the matrix acts in a particularly simple way.
Why Eigenvalues Matter in Engineering
Eigenvalues are useful because they summarize how a system behaves along special directions.
Here are some engineering connections:
- In vibration analysis, eigenvalues can represent natural frequencies of a structure.
- In stability analysis, the size and sign of eigenvalues help determine whether a system grows, decays, or stays balanced.
- In data analysis, eigenvectors can identify major patterns or directions of variation.
- In differential equations, eigenvalues help solve systems that model heat flow, circuits, and motion.
For example, if a bridge has a natural vibration pattern, an external force that matches that pattern can produce large oscillations. The eigenvector shows the mode shape, and the eigenvalue is linked to how that mode behaves.
Another useful idea is that diagonal matrices are easy to work with, and eigenvalues help transform more complicated matrices into simpler forms. This is why eigenvalues are closely related to matrix diagonalization.
Connection to Determinants, Inverses, and Systems of Equations
Eigenvalues fit naturally into the broader study of linear algebra.
Determinants
The characteristic equation uses the determinant:
$$\det\left(A - \lambda I\right) = 0$$
So determinants are the gateway to finding eigenvalues. If $\det\left(A - \lambda I\right) \neq 0$, then the only solution to $\left(A - \lambda I\right)\mathbf{v} = \mathbf{0}$ is the zero vector, so $\lambda$ is not an eigenvalue.
Inverses
A matrix has an inverse only if its determinant is not zero. If $0$ is an eigenvalue of $A$, then
$$\det(A) = 0$$
which means $A$ is singular and has no inverse. So eigenvalues tell us something important about invertibility.
Simultaneous linear equations
Eigenvectors are found by solving a homogeneous system:
$$\left(A - \lambda I\right)\mathbf{v} = \mathbf{0}$$
This connects directly to simultaneous linear equations, because finding eigenvectors means solving a system with infinitely many solutions in the eigenvector direction.
Conclusion
Eigenvalues and eigenvectors give us a powerful way to understand matrices. Instead of looking at how a matrix acts on every possible vector, we look for the special vectors that keep their direction. Those vectors are eigenvectors, and their stretching factors are eigenvalues.
students, this idea is important in engineering mathematics because it helps analyze motion, stability, transformations, and patterns. It also connects strongly to determinants, inverses, and systems of linear equations. Once you understand eigenvalues and eigenvectors, many advanced topics in linear algebra become easier to study 🔍.
Study Notes
- An eigenvector $\mathbf{v}$ of a matrix $A$ satisfies $A\mathbf{v} = \lambda \mathbf{v}$.
- The scalar $\lambda$ is the eigenvalue.
- Eigenvectors are nonzero vectors.
- To find eigenvalues, solve $\det\left(A - \lambda I\right) = 0$.
- After finding an eigenvalue, solve $\left(A - \lambda I\right)\mathbf{v} = \mathbf{0}$ to get eigenvectors.
- Every nonzero scalar multiple of an eigenvector is also an eigenvector.
- Eigenvalues help describe stretching, shrinking, and system behavior.
- A matrix with $0$ as an eigenvalue is singular and has no inverse.
- Eigenvalues and eigenvectors are useful in vibrations, stability, and data analysis.
- This topic connects matrices, determinants, inverses, and homogeneous systems in linear algebra.