Linear Combinations: Building Vectors from Other Vectors 📐

students, in linear algebra, one of the most important ideas is that you can create new vectors by mixing old ones in a very controlled way. This is called a linear combination. It is a foundation for understanding span, linear independence, basis, and dimension, so learning it well makes the rest of the topic much easier.

What is a linear combination?

A linear combination is made by multiplying vectors by numbers and then adding the results. Those numbers are called scalars. If $\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_n$ are vectors and $c_1, c_2, \dots, c_n$ are scalars, then a linear combination has the form

$$c_1\mathbf{v}_1 + c_2\mathbf{v}_2 + \cdots + c_n\mathbf{v}_n$$

The key idea is simple: you are not just adding vectors randomly. You are scaling each vector first, then combining them. That is why the word “linear” matters. The scalars can be any real numbers in many basic linear algebra settings, including $0$, negatives, and fractions.

For example, if $\mathbf{v} = \begin{bmatrix}1\\2\end{bmatrix}$ and $\mathbf{w} = \begin{bmatrix}3\\-1\end{bmatrix}$, then

$$2\mathbf{v} - \mathbf{w} = 2\begin{bmatrix}1\\2\end{bmatrix} - \begin{bmatrix}3\\-1\end{bmatrix} = \begin{bmatrix}2\\4\end{bmatrix} - \begin{bmatrix}3\\-1\end{bmatrix} = \begin{bmatrix}-1\\5\end{bmatrix}$$

That final vector is a linear combination of $\mathbf{v}$ and $\mathbf{w}$. 🚗 Think of it like combining directions on a map: one vector might point east and another north, and the combination tells you a new route.

Why linear combinations matter

Linear combinations are the engine behind many big ideas in linear algebra. students, when you know how to form linear combinations, you can answer questions like:

Can a certain vector be built from given vectors?
Do these vectors cover all of a space?
Are some vectors unnecessary because they can be made from others?
How many vectors are needed to describe a space?

These questions lead directly to span, linear independence, basis, and dimension.

A major reason linear combinations are useful is that they describe what a set of vectors can produce. If you are given vectors in $\mathbb{R}^2$, for example, linear combinations can tell you whether those vectors can make every point in the plane or only some of them. In engineering, combinations of forces can produce a net force. In computer graphics, vectors can combine to position objects on a screen. In economics, combinations of resources can represent possible production outcomes.

Linear combinations and span

The span of a set of vectors is the set of all possible linear combinations of those vectors. If the vectors are $\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_n$, then their span is written as

$$\text{span}\{\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_n\}$$

and it means all vectors of the form

$$c_1\mathbf{v}_1 + c_2\mathbf{v}_2 + \cdots + c_n\mathbf{v}_n$$

This makes linear combinations the building blocks of span. If you understand linear combinations, you understand what span is.

Example in $\mathbb{R}^2$: let

$$\mathbf{v}_1 = \begin{bmatrix}1\\0\end{bmatrix}, \quad \mathbf{v}_2 = \begin{bmatrix}0\\1\end{bmatrix}$$

Any vector $\begin{bmatrix}x\y\end{bmatrix}$ can be written as

$$x\mathbf{v}_1 + y\mathbf{v}_2 = x\begin{bmatrix}1\\0\end{bmatrix} + y\begin{bmatrix}0\\1\end{bmatrix} = \begin{bmatrix}x\y\end{bmatrix}$$

So these two vectors span all of $\mathbb{R}^2$. That means every vector in the plane can be created using linear combinations of these two vectors.

Now compare that with just one vector, such as $\begin{bmatrix}1\\1\end{bmatrix}$. Its span is only a line through the origin, because every linear combination looks like

$$c\begin{bmatrix}1\\1\end{bmatrix} = \begin{bmatrix}c\c\end{bmatrix}$$

That gives vectors where the two coordinates are equal. So one vector in $\mathbb{R}^2$ usually does not span the whole plane.

How to tell whether a vector is a linear combination

A common task is deciding whether one vector can be written as a linear combination of others. This usually turns into solving a system of equations.

Suppose you want to know whether

$$\mathbf{b} = \begin{bmatrix}5\\7\end{bmatrix}$$

is a linear combination of

$$\mathbf{v}_1 = \begin{bmatrix}1\\2\end{bmatrix}, \quad \mathbf{v}_2 = \begin{bmatrix}2\\1\end{bmatrix}$$

You ask whether there are scalars $c_1$ and $c_2$ such that

$$c_1\mathbf{v}_1 + c_2\mathbf{v}_2 = \mathbf{b}$$

This becomes

$$c_1\begin{bmatrix}1\\2\end{bmatrix} + c_2\begin{bmatrix}2\\1\end{bmatrix} = \begin{bmatrix}5\\7\end{bmatrix}$$

which gives the system

$$c_1 + 2c_2 = 5$$

$$2c_1 + c_2 = 7$$

Solving it gives $c_1 = 3$ and $c_2 = 1$. So

$$\begin{bmatrix}5\\7\end{bmatrix} = 3\begin{bmatrix}1\\2\end{bmatrix} + 1\begin{bmatrix}2\\1\end{bmatrix}$$

This means $\mathbf{b}$ is in the span of $\mathbf{v}_1$ and $\mathbf{v}_2$.

A useful habit is to think of this as a “can I build it?” question. If the answer is yes, the vector belongs to the span of the set. If not, then no linear combination of those vectors will reach it.

Linear combinations and linear independence

A set of vectors is linearly independent if none of the vectors can be written as a linear combination of the others. If one vector can be built from the rest, then the set is linearly dependent.

This idea is closely connected to linear combinations because dependence is really about whether a nontrivial linear combination can give the zero vector. A set of vectors $\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_n$ is linearly independent if the only solution to

$$c_1\mathbf{v}_1 + c_2\mathbf{v}_2 + \cdots + c_n\mathbf{v}_n = \mathbf{0}$$

$$c_1 = c_2 = \cdots = c_n = 0$$

If there is a solution where not all coefficients are zero, then the vectors are dependent.

Example: in $\mathbb{R}^2$, the vectors

$$\begin{bmatrix}1\\2\end{bmatrix}, \quad \begin{bmatrix}2\\4\end{bmatrix}$$

are dependent because the second vector is $2$ times the first:

$$\begin{bmatrix}2\\4\end{bmatrix} = 2\begin{bmatrix}1\\2\end{bmatrix}$$

So one of them adds no new direction. This is important because unnecessary vectors do not help expand the span.

On the other hand, the vectors

$$\begin{bmatrix}1\\0\end{bmatrix}, \quad \begin{bmatrix}0\\1\end{bmatrix}$$

are independent. Neither one can be built from the other. Together, they form a very efficient set for describing all of $\mathbb{R}^2$.

Linear combinations, basis, and dimension

A basis is a set of vectors that is both:

linearly independent, and
spans the space.

That means a basis is a smallest useful set of vectors that can build everything in the space using linear combinations.

For $\mathbb{R}^2$, a standard basis is

$$\left\{\begin{bmatrix}1\\0\end{bmatrix}, \begin{bmatrix}0\\1\end{bmatrix}\right\}$$

Every vector in $\mathbb{R}^2$ can be made from these two vectors, and neither one is redundant.

The dimension of a space is the number of vectors in any basis for that space. So the dimension of $\mathbb{R}^2$ is $2$, and the dimension of $\mathbb{R}^3$ is $3$.

This is where linear combinations matter most: if you know which vectors can be combined to form all vectors in a space, you can identify a basis and determine the dimension. For example, in $\mathbb{R}^3$, the three vectors

$$\begin{bmatrix}1\\0\\0\end{bmatrix}, \quad \begin{bmatrix}0\\1\\0\end{bmatrix}, \quad \begin{bmatrix}0\\0\\1\end{bmatrix}$$

form a basis, and any vector $\begin{bmatrix}x\y\z\end{bmatrix}$ can be written as

$$x\begin{bmatrix}1\\0\\0\end{bmatrix} + y\begin{bmatrix}0\\1\\0\end{bmatrix} + z\begin{bmatrix}0\\0\\1\end{bmatrix}$$

So the dimension is $3$.

A real-world picture: mixing ingredients 🍓

Imagine making a smoothie, students. If one ingredient adds sweetness and another adds thickness, then different amounts of each create different results. The final smoothie is like a linear combination of the ingredients. If a set of ingredients can produce every flavor profile you want, then they are spanning the “space” of possible smoothies.

This analogy helps with the math:

the ingredients are like vectors,
the amounts are like scalars,
the final smoothie is like the resulting vector.

If two ingredients are really the same in what they contribute, then one may be redundant, just like dependent vectors. If each ingredient contributes something unique, they may be independent.

Conclusion

Linear combinations are the starting point for many core ideas in linear algebra. They describe how vectors are scaled and added, which leads directly to span. From span, we learn whether vectors cover a space. From there, linear independence tells us whether any vectors are redundant. A basis is the most efficient spanning set, and dimension counts how many vectors are needed in that basis. students, if you can understand linear combinations clearly, you have a strong foundation for the rest of this unit. ✅

Study Notes

A linear combination has the form $c_1\mathbf{v}_1 + c_2\mathbf{v}_2 + \cdots + c_n\mathbf{v}_n$.
Scalars are the numbers used to multiply vectors before adding them.
The span of a set of vectors is the set of all linear combinations of those vectors.
To check whether a vector is in the span, solve for scalars that make the linear combination equal that vector.
A set of vectors is linearly independent if the only solution to $c_1\mathbf{v}_1 + \cdots + c_n\mathbf{v}_n = \mathbf{0}$ is all coefficients equal to $0$.
If one vector can be written as a linear combination of the others, the set is linearly dependent.
A basis is a set of vectors that spans the space and is linearly independent.
The dimension of a space is the number of vectors in any basis for that space.
In $\mathbb{R}^2$, the standard basis has $2$ vectors; in $\mathbb{R}^3$, the standard basis has $3$ vectors.
Linear combinations connect directly to span, linear independence, basis, and dimension, making them one of the most important ideas in linear algebra.