Dimension and Rank

Watch a grid get squeezed flat by a matrix. Count the dimensions that vanish and those that survive.

Dimension counts independent directions. A matrix can squash directions together. Directions crushed to nothing form the kernel's dimension. Directions still spanning room form the rank. The two add up to the original dimension.

For example, sunlight presses a solid object into a flat shadow. The height direction vanishes in the shadow. Only the flat directions survive. Lost plus surviving equals the original dimension.

dim⁡ker⁡T+rank T=dim⁡V\dim\ker T + \mathrm{rank}\,T = \dim V
rank A=dim⁡(column space of A)\mathrm{rank}\,A = \dim(\text{column space of } A)

Examples & Exercises

Show that {(1,0),(0,1)}\{(1, 0), (0, 1)\} is a basis of R2\mathbb{R}^2.

(x,y)=x(1,0)+y(0,1)(x, y) = x(1, 0) + y(0, 1)
The identity matrix — it preserves the standard basis vectors.
Show proof
  1. Independence: if c1(1,0)+c2(0,1)=(0,0)c_1(1, 0) + c_2(0, 1) = (0, 0), coordinates give c1=0c_1 = 0 and c2=0c_2 = 0, so only the trivial combination yields the zero vector.

  2. Span: for any (x,y)∈R2(x, y) \in \mathbb{R}^2, (x,y)=x(1,0)+y(0,1)(x, y) = x(1, 0) + y(0, 1), so the two vectors linearly span all of R2\mathbb{R}^2.

  3. Independent and spanning, hence {(1,0),(0,1)}\{(1, 0), (0, 1)\} is a basis of R2\mathbb{R}^2, and dim⁡R2=2\dim \mathbb{R}^2 = 2.

View A=(123456)A = \begin{pmatrix} 1 & 2 & 3 \\ 4 & 5 & 6 \end{pmatrix} as T:R3→R2T: \mathbb{R}^3 \to \mathbb{R}^2; find its rank and nullity and verify the rank–nullity theorem.

rank⁡T+nullity⁡T=2+1=3=dim⁡R3\operatorname{rank} T + \operatorname{nullity} T = 2 + 1 = 3 = \dim \mathbb{R}^3
A rank-1 matrix — the one-dimensional kernel collapses to the origin, leaving a one-dimensional image.
Show proof
  1. Both rows (1,2,3)(1, 2, 3) and (4,5,6)(4, 5, 6) are nonzero — this check is needed: a zero row IS a scalar multiple (00 times) of the other, so the "not a scalar multiple" criterion yields independence only for nonzero rows.

    Neither row is a scalar multiple of the other (e.g. 4⋅(1,2,3)=(4,8,12)≠(4,5,6)4 \cdot (1, 2, 3) = (4, 8, 12) \ne (4, 5, 6): the multiple 44 forced by the first coordinate already fails at the second), so the rows are linearly independent and the row rank is 22.

    Verify the column rank directly too (without citing row rank == column rank): for the first two columns (1,4)T(1, 4)^T, (2,5)T(2, 5)^T, det⁡(1245)=1⋅5−2⋅4=−3≠0\det \begin{pmatrix} 1 & 2 \\ 4 & 5 \end{pmatrix} = 1 \cdot 5 - 2 \cdot 4 = -3 \ne 0, so these two columns are linearly independent, the column space is all of R2\mathbb{R}^2, and the column rank is also 22.

    Hence rank⁡T=2\operatorname{rank} T = 2.

  2. Substituting (−1,2,−1)T(-1, 2, -1)^T gives 1(−1)+2(2)+3(−1)=−1+4−3=01(-1) + 2(2) + 3(-1) = -1 + 4 - 3 = 0 and 4(−1)+5(2)+6(−1)=−4+10−6=04(-1) + 5(2) + 6(-1) = -4 + 10 - 6 = 0, so it is a nonzero element of the kernel. Thus dim⁡ker⁡T≥1\dim \ker T \ge 1.

  3. Now take any (x,y,z)T∈ker⁡T(x, y, z)^T \in \ker T.

    From the two equations x+2y+3z=0x + 2y + 3z = 0 and 4x+5y+6z=04x + 5y + 6z = 0, subtracting 4 times the first from the second gives −3y−6z=0-3y - 6z = 0, i.e. y=−2zy = -2z.

    Substituting into the first equation, x=−2y−3z=4z−3z=zx = -2y - 3z = 4z - 3z = z, so (x,y,z)=(z,−2z,z)=z⋅(1,−2,1)=(−z)⋅(−1,2,−1)(x, y, z) = (z, -2z, z) = z \cdot (1, -2, 1) = (-z) \cdot (-1, 2, -1).

    Every kernel vector is a scalar multiple of (−1,2,−1)T(-1, 2, -1)^T, so dim⁡ker⁡T≤1\dim \ker T \le 1.

    The previous step gave dim⁡ker⁡T≥1\dim \ker T \ge 1, so the nullity is exactly 11, and rank⁡T+nullity⁡T=2+1=3=dim⁡R3\operatorname{rank} T + \operatorname{nullity} T = 2 + 1 = 3 = \dim \mathbb{R}^3, verifying the rank–nullity theorem — both sides computed directly, with no appeal to the theorem itself.

Find the rank of (1224)\begin{pmatrix} 1 & 2 \\ 2 & 4 \end{pmatrix} by row reduction, and exhibit a basis of its column space.

(1224)→R2−2R1(1200)\begin{pmatrix} 1 & 2 \\ 2 & 4 \end{pmatrix} \xrightarrow{R_2 - 2R_1} \begin{pmatrix} 1 & 2 \\ 0 & 0 \end{pmatrix}
A projection matrix — another rank-1 example with a one-dimensional kernel and image.
Show proof
  1. Applying R2→R2−2R1R_2 \to R_2 - 2R_1 gives (1200)\begin{pmatrix} 1 & 2 \\ 0 & 0 \end{pmatrix}. There is exactly one nonzero row, so the dimension of the row space — the rank — is 11.

  2. The columns satisfy (2,4)T=2(1,2)T(2, 4)^T = 2(1, 2)^T, so one column is a scalar multiple of the other.

    The single column (1,2)T(1, 2)^T spans the whole column space (spanning).

    Independence is also required: since (1,2)T≠(0,0)T(1, 2)^T \ne (0, 0)^T, the singleton {(1,2)T}\{(1, 2)^T\} is linearly independent (if c(1,2)T=0c(1, 2)^T = 0 then c=0c = 0).

  3. Spanning and independent, hence a basis of the column space is {(1,2)T}\{(1, 2)^T\}, and dim⁡\dim(column space) =1== 1 = the rank.

2. Number Systems