August 12, 2025
Complete the following warm-up problems to re-familiarize yourself with concepts we’ll be leveraging today.
Determine whether the vectors \(\left\{\begin{bmatrix} 1\\ 0\\ 0\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\\ 0\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\\ -2\\ 1\end{bmatrix}, \begin{bmatrix} 0\\ 1\\ 0\\ 3\end{bmatrix}\right\}\) span \(\mathbb{R}^4\).
Does the collection \(\left\{\left[\begin{array}{r} 1\\ 0\\ 1\\ 1\end{array}\right], \left[\begin{array}{r} 0\\ 2\\ 0\\ 0\end{array}\right], \left[\begin{array}{r} 1\\ 0\\ 0\\ 1\end{array}\right]\right\}\) also span \(\mathbb{R}^4\).
How many vectors are required to span \(\mathbb{R}^n\)?
Consider the map below. Provide directions to get from the House to the Store.
Goals for Today: After today’s discussion, you should be able to
In our scheduled Day 10 and 11 discussion, we introduced the notion of spans and linear independence, respectively.
Given a space and a collection of vectors, we asked and answered questions like:
You might intuitively understand these questions as:
It becomes natural now to ask whether we can obtain a collection of vectors with exactly enough information to reconstruct a space without having any redundancies.
Such a collection is called a basis for the space.
Definition (Basis): A basis for any subspace \(H\) of \(\mathbb{R}^n\) is a linearly independent set of vectors from \(H\) which span \(H\). Sometimes we say that a basis is a linearly independent spanning set.
Strategy: Given a collection \(V\) of vectors, if we want to identify whether that collection of vectors is a basis for \(\mathbb{R}^n\), then all of the following must be true…
Actually, the final bullet point above encompasses all of the others, so that is the only one we need to check.
Example 1: Determine whether the collection of vectors
\[V = \left\{\begin{bmatrix} 1\\ 0\\ 0\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\\ 0\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\\ 1\\ 0\end{bmatrix}\right\}\]
is a basis for \(\mathbb{R}^4\).
Example 2: Determine whether the collection of vectors
\[V = \left\{\begin{bmatrix} 3\\ -3\\ 4\end{bmatrix}, \begin{bmatrix} 0\\ 8\\ -1\end{bmatrix}, \begin{bmatrix} 6\\ 18\\ 11\end{bmatrix}\right\}\]
is a basis for \(\mathbb{R}^3\).
Example 3: Determine whether the collection of vectors
\[V = \left\{\begin{bmatrix} 2\\ 8\end{bmatrix}, \begin{bmatrix} 1\\ -5\end{bmatrix}, \begin{bmatrix} 6\\ 10\end{bmatrix}\right\}\]
is a basis for \(\mathbb{R}^2\).
Example 4: Determine whether the collection of vectors
\[V = \left\{\begin{bmatrix} -6\\ 1\\ 2\end{bmatrix}, \begin{bmatrix} 5\\ 0\\ -8\end{bmatrix}\right\}\]
is a basis for \(\mathbb{R}^3\).
There are some quick assertions we can make regarding bases for \(\mathbb{R}^n\).
Important Note: If the vectors in \(V\) have exactly \(n\) entries, and there are exactly \(n\) vectors in \(V\), that does not guarantee that \(V\) is a basis for \(\mathbb{R}^n\).
Theorem/Guarantee: Any linearly independent collection of \(n\) vectors from \(\mathbb{R}^n\) is a basis for \(\mathbb{R}^n\).
Undoubtedly, you’ve encountered the notion of the dimension of a space and you’ve internalized that notion well enough that it has become intuitive.
This is the first time, however, that we are prepared to rigorously define what is meant by dimension.
Definition (Dimension): The dimension of a space is the number of vectors in a basis for it.
Example: Determine the dimension of the space spanned by the vectors
\[V = \left\{\begin{bmatrix} 1\\ 8\\ -1\end{bmatrix}, \begin{bmatrix} 0\\ 2\\ -3\end{bmatrix}, \begin{bmatrix} 1\\ 10\\ -4\end{bmatrix}\right\}\]
Example: Determine the dimension of the space spanned by the vectors
\[V = \left\{\begin{bmatrix} 1\\ 8\end{bmatrix}, \begin{bmatrix} 5\\ 40\end{bmatrix}, \begin{bmatrix} -2\\ -16\end{bmatrix}\right\}\]
Example: Determine the dimension of the space spanned by the vectors
\[V = \left\{\begin{bmatrix} 1\\ 0\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\\ 1\end{bmatrix}\right\}\]
The standard basis for \(\mathbb{R}^n\) is \[\mathscr{B} = \left\{\begin{bmatrix} 1\\ 0\\ 0\\ \vdots\\ 0\\ 0\end{bmatrix}, \begin{bmatrix} 0\\ 1\\ 0\\ \vdots\\ 0\\ 0\end{bmatrix}, \cdots, \begin{bmatrix} 0\\ 0\\ 0\\ \vdots\\ 0\\ 1\end{bmatrix}\right\}\]
\[\mathscr{B}_2 = \left\{\begin{bmatrix} 1\\ 0\end{bmatrix}, \begin{bmatrix} 0\\ 1\end{bmatrix}\right\}~~~~~\mathscr{B}_3 = \left\{\begin{bmatrix} 1\\ 0\\ 0\end{bmatrix}, \begin{bmatrix} 0\\ 1\\ 0\end{bmatrix}, \begin{bmatrix} 0\\ 0\\ 1\end{bmatrix}\right\}\]
Standard Basis Vectors and the Identity Matrix: Notice that the standard basis vectors for \(\mathbb{R}^n\) are the columns of the identity matrix \(I_n\).
Note: We encountered these vectors previously and, given a space, we’ve labeled \(\vec{e_i}\) as the \(i^{\text{th}}\) column of the identity matrix in that space.
Example: Is the following collection a basis for \(\mathbb{R}^n\)? Is it the standard basis for \(\mathbb{R}^n\)?
\[\mathscr{B} = \left\{\begin{bmatrix} 1\\ 0\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\\ 1\end{bmatrix}\right\}\]
Example: Is the following collection a basis for \(\mathbb{R}^n\)? Is it the standard basis for \(\mathbb{R}^n\)?
\[\mathscr{B} = \left\{\begin{bmatrix} 1\\ 0\end{bmatrix}, \begin{bmatrix} 0\\ 1\end{bmatrix}\right\}\]
The vector notation that we’ve been utilizing so far in our course depends on these standard basis vectors.
For example, we’ve assumed that the vector \(\vec{v} = \begin{bmatrix} 5\\ -4\\ 2\end{bmatrix}\) is the vector
\[5\vec{e_1} + \left(-4\right)\vec{e_2} + 2\vec{e_3}\]
That is, the location of this vector is arrived at by starting at the origin, moving \(5\) times in the direction and magnitude of \(\vec{e_1}\), \(4\) times in the direction and magnitude opposite \(\vec{e_2}\), and twice in the direction and magnitude of \(\vec{e_3}\).
Example: Consider the vector \(\vec{v} = \begin{bmatrix} 7\\ -3\end{bmatrix}\).
The vector notation that we’ve been utilizing so far in our course depends on these standard basis vectors.
For example, we’ve assumed that the vector \(\vec{v} = \begin{bmatrix} 5\\ -4\\ 2\end{bmatrix}\) is the vector
\[5\vec{e_1} + \left(-4\right)\vec{e_2} + 2\vec{e_3}\]
That is, the location of this vector is arrived at by starting at the origin, moving \(5\) times in the direction and magnitude of \(\vec{e_1}\), \(4\) times in the direction and magnitude opposite \(\vec{e_2}\), and twice in the direction and magnitude of \(\vec{e_3}\).
Example: Consider the vector \(\vec{v} = \begin{bmatrix} 7\\ -3\end{bmatrix}\). Identify the space (\(\mathbb{R}^n\)) that the vector sits in, identify the standard basis vectors for this space, and describe the location of the vector \(\vec{v}\) using those standard basis vectors.
The importance of having a basis is that any vector in the corresponding space has a unique decomposition in terms of the basis vectors.
A general spanning set does not provide this uniqueness.
Example: The set \(\left\{\left[\begin{array}{r} 1\\ 0\end{array}\right], \left[\begin{array}{r} 1\\ 1\end{array}\right], \left[\begin{array}{r} 0\\ 1\end{array}\right]\right\}\) spans \(\mathbb{R}^2\).
The vector \(\left[\begin{array}{r}5\\ -2\end{array}\right]\) can be written as \(5\left[\begin{array}{r}1\\ 0\end{array}\right] - 2\left[\begin{array}{r} 0\\ 1\end{array}\right]\) and also as \(5\left[\begin{array}{r} 1\\ 1\end{array}\right] - 7\left[\begin{array}{r} 0\\ 1\end{array}\right]\) (and infinitely many other ways too!).
The set \(\left\{\left[\begin{array}{r} 1\\ 0\end{array}\right], \left[\begin{array}{r} 1\\ 1\end{array}\right]\right\}\) also spans \(\mathbb{R}^2\), but since the vectors are linearly independent, the set forms a basis for \(\mathbb{R}^2\). Using this basis, there is only one way to decompose the vector \(\left[\begin{array}{r} 5\\ -2\end{array}\right]\). It is \(7\left[\begin{array}{r} 1\\ 0\end{array}\right] - 2\left[\begin{array}{r} 1\\ 1\end{array}\right]\).
Note: Any set of \(n\) linearly independent vectors from \(\mathbb{R}^n\) is a basis for \(\mathbb{R}^n\).
Some bases are more intuitive and efficient than others, though. Consider the bases for \(\mathbb{R}^2\) below.
\[\mathscr{B}_s = \left\{\begin{bmatrix} 1\\ 0\end{bmatrix}, \begin{bmatrix} 0\\ 1\end{bmatrix}\right\}~~~~~\mathscr{B}_1 = \left\{\begin{bmatrix} 1\\ 0\end{bmatrix}, \begin{bmatrix} 1\\ 1\end{bmatrix}\right\}~~~~~\mathscr{B}_2 = \left\{\begin{bmatrix} -2\\ -3\end{bmatrix}, \begin{bmatrix} 1\\ 0.5\end{bmatrix}\right\}\]
In this case, it was much more useful to use the streets than it was to use the usual N-S/E-W cardinal directions. Since it was easier and more effective to navigate in the directions of the roadways, you chose to do that, which is a completely valid and justifiable choice to make.
You performed a change of basis.
The choice of basis is not unique.
However, once we’ve chosen a basis, each vector in our space has a unique representation under the basis.
Additionally, we see that the choice of basis vectors determines the structure of our space.
Definition (Basis Representation of Vectors): Suppose that \(\mathscr{B} = \left\{\vec{b_1}, \vec{b_2}, \cdots, \vec{b_p}\right\}\) is a basis for a space \(H\).
In this first example, we’ll convert a vector from a non-standard basis representation into its corresponding standard basis representation.
Example: Consider the basis \(\mathscr{B} = \left\{\left[\begin{array}{r} -2\\ 3\end{array}\right], \left[\begin{array}{r} 1\\ 5\end{array}\right]\right\}\) and determine the position of the vector \(\left[\vec{x}\right]_{\mathscr{B}} = \left[\begin{array}{r} 5\\ -1\end{array}\right]\) in \(\mathbb{R}^2\) under the standard basis \(\mathscr{B}_S = \left\{\left[\begin{array}{r} 1\\ 0\end{array}\right], \left[\begin{array}{r} 0\\ 1\end{array}\right]\right\}\).
The vector \(\left[\vec{x}\right]_{\mathscr{B}} = \left[\begin{array}{r} 5\\ -1\end{array}\right]\) is the vector \(5\left[\begin{array}{r} -2\\ 3\end{array}\right] + \left(-1\right)\left[\begin{array}{r} 1\\ 5\end{array}\right]\).
We can simplify the linear combination to obtain the representation of \(\vec{x}\) in the standard basis.
That is, \(\vec{x} = \left[\begin{array}{r} -11\\ 10\end{array}\right]\) in the standard basis \(\mathscr{B}_{S} = \left\{\left[\begin{array}{r} 1\\ 0\end{array}\right], \left[\begin{array}{r} 0\\ 1\end{array}\right]\right\}\).
Notice that the standard basis forms our usual “\(x\)” and “\(y\)” axes. \(_\blacktriangledown\)
This time, we’ll convert from the standard basis representation to a non-standard basis representation.
Example: Consider the basis \(\mathscr{B} = \left\{\left[\begin{array}{r} -2\\ 3\end{array}\right], \left[\begin{array}{r} 1\\ 5\end{array}\right]\right\}\) and determine the \(\mathscr{B}\)-coordinates of the vector \(\vec{x} = \left[\begin{array}{r} -5\\ 14\end{array}\right]\).
In order to find the \(\mathscr{B}\)-coordinates for our vector \(\vec{x}\), we need to write \(\vec{x}\) as a linear combination of the vectors in \(\mathscr{B}\).
The \(\mathscr{B}\)-coordinates of the vector \(\vec{x}\) will be the weights from that linear combination.
That is, \(\left[\vec{x}\right]_{\mathscr{B}} = \left[\begin{array}{r} c_1\\ c_2\end{array}\right]\), where \(\vec{x} = c_1\left[\begin{array}{r} -2\\ 3\end{array}\right] + c_2\left[\begin{array}{r} 1\\ 5\end{array}\right]\).
This time, we’ll convert from the standard basis representation to a non-standard basis representation.
Example: Consider the basis \(\mathscr{B} = \left\{\left[\begin{array}{r} -2\\ 3\end{array}\right], \left[\begin{array}{r} 1\\ 5\end{array}\right]\right\}\) and determine the \(\mathscr{B}\)-coordinates of the vector \(\vec{x} = \left[\begin{array}{r} -5\\ 14\end{array}\right]\).
We’ll find \(c_1\) and \(c_2\) by setting up an appropriate augmented matrix, \(\left[\begin{array}{rr|r} -2 & 1 & -5\\ 3 & 5 & 14\end{array}\right]\) and row-reducing to solve.
This time, we’ll convert from the standard basis representation to a non-standard basis representation.
Example: Consider the basis \(\mathscr{B} = \left\{\left[\begin{array}{r} -2\\ 3\end{array}\right], \left[\begin{array}{r} 1\\ 5\end{array}\right]\right\}\) and determine the \(\mathscr{B}\)-coordinates of the vector \(\vec{x} = \left[\begin{array}{r} -5\\ 14\end{array}\right]\).
(Matrix([
[1, 0, 3.0],
[0, 1, 1.0]]), (0, 1))
From here, we see that \(c_1 = 3\) and \(c_2 = 1\). That is, the \(\mathscr{B}\)-coordinates for \(\vec{x}\) are \(\left[\vec{x}\right]_{\mathscr{B}} = \left[\begin{array}{r} 3\\ 1\end{array}\right]\). \(_\blacktriangledown\)
Example: Consider the basis \(\mathscr{B} = \left\{\left[\begin{array}{r} 2\\ 2\end{array}\right], \left[\begin{array}{r} -1\\ 3\end{array}\right]\right\}\) and determine the position of the vector \(\left[\vec{x}\right]_{\mathscr{B}} = \left[\begin{array}{r} 5\\ -1\end{array}\right]\) in the \(\mathbb{R}^2\) under the standard basis \(\mathscr{B}_S = \left\{\left[\begin{array}{r} 1\\ 0\end{array}\right], \left[\begin{array}{r} 0\\ 1\end{array}\right]\right\}\).
Example: Find a basis for the space spanned by the vectors \(\left[\begin{array}{r} 1\\ -1\\ -2\\ 3\end{array}\right]\), \(\left[\begin{array}{r} 2\\ -3\\ -1\\ 4\end{array}\right]\), \(\left[\begin{array}{r} 0\\ -1\\ 3\\ -2\end{array}\right]\), \(\left[\begin{array}{r} -1\\ 4\\ -7\\ 7\end{array}\right]\), and \(\left[\begin{array}{r} 3\\ -7\\ 6\\ -9\end{array}\right]\). What is the dimension of the subspace?
Example: Consider the basis \(\mathscr{B} = \left\{\begin{bmatrix} 1\\ -3\\ 2\end{bmatrix}, \begin{bmatrix} 3\\ 3\\ 1\end{bmatrix}, \begin{bmatrix} -2\\ 0\\ 6\end{bmatrix}\right\}\). Find the \(\mathscr{B}\)-representation of the vector \(\begin{bmatrix} 5\\ 4\\ 1\end{bmatrix}\).
\[\Huge{\text{Complete Homework 8}}\] \[\Huge{\text{on MyOpenMath}}\]
\(\Huge{\text{Image Compression}}\)