7. Span, Linear Independence, Basis, and Dimension

Basis

Basis: The Smallest Set That Does the Job

students, today you will learn one of the most important ideas in linear algebra: a basis. A basis is a special set of vectors that can build every vector in a space, but with no unnecessary vectors included. Think of it like packing a backpack πŸŽ’: you want everything you need, but nothing extra weighing you down. By the end of this lesson, you should be able to explain what a basis is, test whether a set of vectors is a basis, and see how basis connects to span, linear independence, and dimension.

What Is a Basis?

A basis of a vector space is a set of vectors that satisfies two conditions:

  1. The vectors span the space.
  2. The vectors are linearly independent.

That means a basis can create every vector in the space, and none of its vectors can be written as a combination of the others.

For example, in the plane $\mathbb{R}^2$, the vectors $\begin{bmatrix}1\\0\end{bmatrix}$ and $\begin{bmatrix}0\\1\end{bmatrix}$ form a basis. Any vector $\begin{bmatrix}a\b\end{bmatrix}$ in the plane can be written as

$$

$\begin{bmatrix}$a\b$\end{bmatrix}$=a$\begin{bmatrix}1$\\$0\end{bmatrix}$+b$\begin{bmatrix}0$\\$1\end{bmatrix}$.

$$

These two vectors are also linearly independent because neither one can be made from the other. This is why they are called the standard basis for $\mathbb{R}^2$.

A good way to think about a basis is with directions on a map πŸ—ΊοΈ. If you know the two main directions needed to move anywhere in a city grid, you do not need every possible street. Just those two directions are enough.

How Basis Connects to Span and Linear Independence

Basis is where two big ideas meet:

  • Span tells us what a set of vectors can reach.
  • Linear independence tells us whether any vector is unnecessary.

If a set of vectors spans a space but has extra vectors, it is not a basis yet. If a set is linearly independent but does not reach the whole space, it is also not a basis.

To be a basis, the set must do both jobs at once.

Example in $\mathbb{R}^2$

Consider the vectors

$$

$\begin{bmatrix}1$\\$0\end{bmatrix}$,\quad $\begin{bmatrix}0$\\$1\end{bmatrix}$,\quad $\begin{bmatrix}1$\\$1\end{bmatrix}$.

$$

These vectors span $\mathbb{R}^2$, because the first two already do. But the set is not linearly independent, since

$$

$\begin{bmatrix}1$\\$1\end{bmatrix}$=$\begin{bmatrix}1$\\$0\end{bmatrix}$+$\begin{bmatrix}0$\\$1\end{bmatrix}$.

$$

So this set is not a basis. It has too many vectors.

Now look at just

$$

$\begin{bmatrix}1\\0\end{bmatrix},\quad \begin{bmatrix}0\\1\end{bmatrix}.$

$$

This set spans $\mathbb{R}^2$ and is linearly independent, so it is a basis.

Why this matters

This connection helps us avoid confusion. A basis is not just any set of vectors that seems useful. It is the right-sized set: enough vectors to build the space, but not so many that some are redundant.

How to Check Whether a Set Is a Basis

To decide whether vectors form a basis, students, you usually check two things:

  1. Do they span the space?
  2. Are they linearly independent?

For vectors in $\mathbb{R}^n$, there is often a faster shortcut:

  • If a set has exactly $n$ vectors in $\mathbb{R}^n$ and they are linearly independent, then they form a basis.
  • If a set has exactly $n$ vectors in $\mathbb{R}^n$ and they span $\mathbb{R}^n$, then they also form a basis.

This works because in $\mathbb{R}^n$, any basis must have exactly $n$ vectors.

Example: Basis in $\mathbb{R}^3$

Consider the vectors

$$

$\begin{bmatrix}1$\\0\\$0\end{bmatrix}$,\quad $\begin{bmatrix}0$\\1\\$0\end{bmatrix}$,\quad $\begin{bmatrix}0$\\0\\$1\end{bmatrix}$.

$$

These form the standard basis of $\mathbb{R}^3$. They are linearly independent, and any vector

$$

$\begin{bmatrix}a\b\c\end{bmatrix}$

$$

can be written as

$$

$\begin{bmatrix}$a\b\c$\end{bmatrix}$=a$\begin{bmatrix}1$\\0\\$0\end{bmatrix}$+b$\begin{bmatrix}0$\\1\\$0\end{bmatrix}$+c$\begin{bmatrix}0$\\0\\$1\end{bmatrix}$.

$$

So they span the space too.

Example: Not a basis in $\mathbb{R}^3$

Suppose we have

$$

$\begin{bmatrix}1$\\2\\$3\end{bmatrix}$,\quad $\begin{bmatrix}2$\\4\\$6\end{bmatrix}$,\quad $\begin{bmatrix}0$\\1\\$1\end{bmatrix}$.

$$

The first two vectors are dependent because

$$

$\begin{bmatrix}2\\4\\6\end{bmatrix}=2\begin{bmatrix}1\\2\\3\end{bmatrix}.$

$$

Since the set is not linearly independent, it cannot be a basis.

A common method is to place the vectors into a matrix and row-reduce it. If the columns are pivot columns and there are exactly $n$ vectors in $\mathbb{R}^n$, then the set is a basis.

Basis and Dimension

The dimension of a vector space is the number of vectors in any basis for that space.

This is a huge idea 🌟 because it tells us that all bases for the same space have the same number of vectors.

For example:

  • The dimension of $\mathbb{R}^2$ is $2$.
  • The dimension of $\mathbb{R}^3$ is $3$.
  • The dimension of the set of all polynomials of degree at most $2$ is $3$, with basis $\{1, x, x^2\}$.

Example with polynomials

The set

$$

$\{1, x, x^2\}$

$$

is a basis for the vector space of polynomials of degree at most $2$, often written as $P_2$. Any polynomial in $P_2$ looks like

$$

$ax^2+bx+c,$

$$

and can be written as

$$

$ax^2+bx+c=c\cdot 1+b\cdot x+a\cdot x^2.$

$$

The set spans $P_2$, and the three vectors are linearly independent. Therefore, it is a basis, and the dimension of $P_2$ is $3$.

Why dimension matters

Dimension tells us how many independent directions are needed to describe a space. In a music app 🎡, for instance, you might think of three sliders controlling bass, mid, and treble. If one slider can be recreated from the others, it is not giving new information. A basis is like the smallest complete set of controls needed to describe every sound in the system.

Finding a Basis from a Spanning Set

Sometimes a set spans a space, but it has extra vectors. In that case, you can find a basis by removing dependent vectors one at a time.

Example

Suppose we have the vectors

$$

$\begin{bmatrix}1$\\0\\$0\end{bmatrix}$,\quad $\begin{bmatrix}0$\\1\\$0\end{bmatrix}$,\quad $\begin{bmatrix}1$\\1\\$0\end{bmatrix}$.

$$

These vectors span a subspace of $\mathbb{R}^3$. But the third vector is redundant because

$$

$\begin{bmatrix}1$\\1\\$0\end{bmatrix}$=$\begin{bmatrix}1$\\0\\$0\end{bmatrix}$+$\begin{bmatrix}0$\\1\\$0\end{bmatrix}$.

$$

So a basis is

$$

$\left\{$$\begin{bmatrix}1$\\0\\$0\end{bmatrix}$,$\begin{bmatrix}0$\\1\\$0\end{bmatrix}$$\right\}$.

$$

This basis still spans the same subspace, but now there are no unnecessary vectors.

The big idea

A basis is not just any generating set. It is a minimal spanning set. That means:

  • it still reaches every vector in the space,
  • but removing any vector would make it stop spanning.

Why Basis Is Important in Real Life and in Math

Basis gives us a coordinate system for a space. When you write a vector as a combination of basis vectors, the coefficients are the coordinates of that vector relative to that basis.

For example, in the standard basis of $\mathbb{R}^2$, the vector

$$

$\begin{bmatrix}5\\-2\end{bmatrix}$

$$

has coordinates $5$ and $-2$ because

$$

$\begin{bmatrix}5$\\-$2\end{bmatrix}$=$5\begin{bmatrix}1$\\$0\end{bmatrix}$+(-2)$\begin{bmatrix}0$\\$1\end{bmatrix}$.

$$

In computer graphics, different basis choices can make calculations easier. In engineering, a good basis can simplify how signals or forces are described. In data science, basis ideas help organize information into independent features.

So basis is not just a definition to memorize. It is a tool for organizing and simplifying mathematical structure.

Conclusion

students, a basis is the perfect team of vectors for a space: enough to build everything, but with no redundancy. It connects directly to span and linear independence, and it determines the dimension of the space. If you understand basis, you understand a major organizing principle in linear algebra. When you see a vector space, ask: Which vectors generate it? Which vectors are unnecessary? What is the smallest complete set? Those questions lead straight to basis.

Study Notes

  • A basis is a set of vectors that both spans a vector space and is linearly independent.
  • A basis is a minimal spanning set and also a maximal linearly independent set.
  • In $\mathbb{R}^n$, any basis has exactly $n$ vectors.
  • The dimension of a vector space is the number of vectors in any basis.
  • The standard basis of $\mathbb{R}^2$ is $\left\{\begin{bmatrix}1\\0\end{bmatrix},\begin{bmatrix}0\\1\end{bmatrix}\right\}$.
  • The standard basis of $\mathbb{R}^3$ is $\left\{\begin{bmatrix}1\\0\\0\end{bmatrix},\begin{bmatrix}0\\1\\0\end{bmatrix},\begin{bmatrix}0\\0\\1\end{bmatrix}\right\}$.
  • A set can span a space but still fail to be a basis if it has dependent vectors.
  • A set can be independent but still fail to be a basis if it does not span the space.
  • To test for a basis, check span and linear independence, often using row reduction.
  • Basis vectors give coordinates for every vector in the space.

Practice Quiz

5 questions to test your understanding