Lesson 4.5: Eigenvalues and Eigenvectors

Introduction

Welcome to Lesson 4.5 on Eigenvalues and Eigenvectors! In this lesson, we will explore the fascinating world of these concepts that play crucial roles in various fields such as physics, data science, and computer graphics.

Objectives

By the end of this lesson, students will be able to:

• Understand the eigenvalue equation $Av = \lambda v$ and the characteristic equation.
• Find eigenvalues and corresponding eigenvectors of 2×2 (and basic 3×3) matrices.
• Recognize eigenvectors as invariant directions of a transformation.
• Get a first look at diagonalization and its usefulness.
• Form and solve the characteristic equation of a matrix.

What are Eigenvalues and Eigenvectors?

To begin our journey, let's break down what eigenvalues and eigenvectors really are. In simple terms:

• Eigenvalues are special numbers that tell us how much a transformation will stretch or compress vectors.
• Eigenvectors are the directions that remain unchanged (except for stretching or compressing) when transformations are applied.

The Eigenvalue Equation

The relationship between an eigenvector and eigenvalue can be represented using the equation:

$$Av = \lambda v$$

Here:

• $A$ is a square matrix.
• $v$ is an eigenvector of $A$.
• $\lambda$ is the eigenvalue associated with eigenvector $v$.

Real-World Example

Think of a metal rod being stretched when a force is applied along its length. The direction of the rod does not change; it only stretches. In this scenario, the direction of the rod represents the eigenvector, and the factor by which it stretches represents the eigenvalue.

Finding Eigenvalues and Eigenvectors

Now, let’s dive into how we can find the eigenvalues and eigenvectors for a 2×2 matrix.

Step 1: Set Up the Characteristic Equation

To find the eigenvalues, we need to compute the characteristic equation. This is derived from:

$$\text{det}(A - \lambda I) = 0$$

where $I$ is the identity matrix of the same size as $A$.

Step 2: Example with a 2×2 Matrix

Consider the matrix:

$$A = \begin{pmatrix} 4 & 2 \\ 1 & 3 \end{pmatrix}$$

Let’s find the eigenvalues:

1. Set up the equation:

$$\text{det}\left( \begin{pmatrix} 4 & 2 \\ 1 & 3 \end{pmatrix} - \lambda \begin{pmatrix} 1 & 0 \\ 0 & 1 \end{pmatrix}\right) = 0$$

This simplifies to:

$$\text{det}\begin{pmatrix} 4 - \lambda & 2 \\ 1 & 3 - \lambda \end{pmatrix} = 0$$

1. Calculate the determinant:

$$ (4 - \lambda)(3 - \lambda) - 2 \cdot 1 = 0$$

This expands to:

$$\lambda^2 - 7\lambda + 10 = 0$$

1. Solve for $\lambda$:

Using the quadratic formula, $\lambda = \frac{-b \pm \sqrt{b^2 - 4ac}}{2a}$, where $a = 1$, $b = -7$, and $c = 10$:

$$\lambda = \frac{7 \pm \sqrt{(-7)^2 - 4 \cdot 1 \cdot 10}}{2 \cdot 1}$$

$$\lambda = \frac{7 \pm \sqrt{49 - 40}}{2}$$

$$\lambda = \frac{7 \pm 3}{2}$$

Thus, we get two eigenvalues:

$$\lambda_1 = 5, \quad \lambda_2 = 2$$

Step 3: Finding Eigenvectors

Now, we need to find the eigenvectors corresponding to each eigenvalue.

1. For $\lambda_1 = 5$:

Set up the equation:

$$\begin{pmatrix} 4 - 5 & 2 \\ 1 & 3 - 5 \end{pmatrix} \begin{pmatrix} x_1 \\ x_2 \end{pmatrix} = 0$$

This simplifies to:

$$\begin{pmatrix} -1 & 2 \\ 1 & -2 \end{pmatrix} \begin{pmatrix} x_1 \\ x_2 \end{pmatrix} = 0$$

Solving gives:

$$x_2 = \frac{1}{2}x_1$$

Thus, one eigenvector is any scalar multiple of:

$$\begin{pmatrix} 2 \\ 1 \end{pmatrix}$$

1. For $\lambda_2 = 2$:

Set up the equation:

$$\begin{pmatrix} 4 - 2 & 2 \\ 1 & 3 - 2 \end{pmatrix} \begin{pmatrix} x_1 \\ x_2 \end{pmatrix} = 0$$

This simplifies to:

$$\begin{pmatrix} 2 & 2 \\ 1 & 1 \end{pmatrix} \begin{pmatrix} x_1 \\ x_2 \end{pmatrix} = 0$$

Solving gives:

$$x_2 = -x_1$$

Thus, one eigenvector is any scalar multiple of:

$$\begin{pmatrix} 1 \\ -1 \end{pmatrix}$$

Diagonalization

Diagonalization is the process of finding a diagonal matrix $D$ such that:

$$A = PDP^{-1}$$

Where $P$ is the matrix containing the eigenvectors as columns. Diagonalization is useful because it simplifies the computation of matrix powers and can help in solving systems of differential equations.

Why is it Useful?

When you diagonalize a matrix, it allows you to easily compute powers of the matrix, which is particularly beneficial in solving systems of linear equations and analyzing their behavior over time.

Conclusion

In this lesson, we learned about eigenvalues and eigenvectors, how to find them, and the concept of diagonalization. These tools help us understand the structure of linear transformations better and have applications in many areas.

Study Notes

• Eigenvalues are factors by which eigenvectors are stretched or compressed.
• The eigenvalue equation is $Av = \lambda v$.
• The characteristic equation is $\text{det}(A - \lambda I) = 0$.
• To find eigenvectors, solve the equation $(A - \lambda I)v = 0$ for each eigenvalue.
• Diagonalization expresses a matrix in a simpler form, making calculations easier.