Linear Algebra/Any Matrix Represents a Linear Map

Linear Algebra Any Matrix Represents a Linear Map Representing Linear Maps with Matrices Matrix Operations The prior subsection shows that the action of a linear map is described by a matrix , with respect to appropriate bases, in this way. In this subsection, we will show the converse, that each matrix represents a linear map. Recall that, in the definition of the matrix representation of a linear map, the number of columns of the matrix is the dimension of the map's domain and the number of rows of the matrix is the dimension of the map's codomain. Thus, for instance, a matrix cannot represent a map from to . The next result says that, beyond this restriction on the dimensions, there are no other limitations: the matrix represents a map from any three-dimensional space to any two-dimensional space. Theorem 2.1th:MatIsLinMap Any matrix represents a homomorphism between vector spaces of appropriate dimensions, with respect to any pair of bases. Proof For the matrix fix any -dimensional domain space and any -dimensional codomain space . Also fix bases and for those spaces. Define a function by: where in the domain is represented as then its image is the member the codomain represented by that is, is defined to be . (This is well-defined by the uniqueness of the representation .) Observe that has simply been defined to make it the map that is represented with respect to by the matrix . So to finish, we need only check that is linear. If are such that and then the calculation provides this verification. Example 2.2ex:CngBasesChgMap Which map the matrix represents depends on which bases are used. If then represented by with respect to maps while represented by with respect to is this map. These two are different. The first is projection onto the axis, while the second is projection onto the axis. So not only is any linear map described by a matrix but any matrix describes a linear map. This means that we can, when convenient, handle linear maps entirely as matrices, simply doing the computations, without have to worry that a matrix of interest does not represent a linear map on some pair of spaces of interest. (In practice, when we are working with a matrix but no spaces or bases have been specified, we will often take the domain and codomain to be and and use the standard bases. In this case, because the representation is transparent— the representation with respect to the standard basis of is — the column space of the matrix equals the range of the map. Consequently, the column space of is often denoted by .) With the theorem, we have characterized linear maps as those maps that act in this matrix way. Each linear map is described by a matrix and each matrix describes a linear map. We finish this section by illustrating how a matrix can be used to tell things about its maps. Theorem 2.3th:RankMatEqRankMap The rank of a matrix equals the rank of any map that it represents. Proof Suppose that the matrix is . Fix domain and codomain spaces and of dimension and , with bases and . Then represents some linear map between those spaces with respect to these bases whose rangespace is the span . The rank of is the dimension of this rangespace. The rank of the matrix is its column rank (or its row rank; the two are equal). This is the dimension of the column space of the matrix, which is the span of the set of column vectors . To see that the two spans have the same dimension, recall that a representation with respect to a basis gives an isomorphism . Under this isomorphism, there is a linear relationship among members of the rangespace if and only if the same relationship holds in the column space, e.g, if and only if . Hence, a subset of the rangespace is linearly independent if and only if the corresponding subset of the column space is linearly independent. This means that the size of the largest linearly independent subset of the rangespace equals the size of the largest linearly independent subset of the column space, and so the two spaces have the same dimension. Example 2.4 Any map represented by must, by definition, be from a three-dimensional domain to a four-dimensional codomain. In addition, because the rank of this matrix is two (we can spot this by eye or get it with Gauss' method), any map represented by this matrix has a two-dimensional rangespace. Corollary 2.5cor:MatDescsMap Let be a linear map represented by a matrix . Then is onto if and only if the rank of equals the number of its rows, and is one-to-one if and only if the rank of equals the number of its columns. Proof For the first half, the dimension of the rangespace of is the rank of , which equals the rank of by the theorem. Since the dimension of the codomain of is the number of rows in , if the rank of equals the number of rows, then the dimension of the rangespace equals the dimension of the codomain. But a subspace with the same dimension as its superspace must equal that superspace (a basis for the rangespace is a linearly independent subset of the codomain, whose size is equal to the dimension of the codomain, and so this set is a basis for the codomain). For the second half, a linear map is one-to-one if and only if it is an isomorphism between its domain and its range, that is, if and only if its domain has the same dimension as its range. But the number of columns in is the dimension of 's domain, and by the theorem the rank of equals the dimension of 's range. The above results end any confusion caused by our use of the word "rank" to mean apparently different things when applied to matrices and when applied to maps. We can also justify the dual use of "nonsingular". We've defined a matrix to be nonsingular if it is square and is the matrix of coefficients of a linear system with a unique solution, and we've defined a linear map to be nonsingular if it is one-to-one. Corollary 2.6cor:NonsingMatIffNonsingMap A square matrix represents nonsingular maps if and only if it is a nonsingular matrix. Thus, a matrix represents an isomorphism if and only if it is square and nonsingular. Proof Immediate from the prior result. Example 2.7 Any map from to represented with respect to any pair of bases by is nonsingular because this matrix has rank two. Example 2.8ex:NonSMatHasNonSMap Any map represented by is not nonsingular because this matrix is not nonsingular. We've now seen that the relationship between maps and matrices goes both ways: fixing bases, any linear map is represented by a matrix and any matrix describes a linear map. That is, by fixing spaces and bases we get a correspondence between maps and matrices. In the rest of this chapter we will explore this correspondence. For instance, we've defined for linear maps the operations of addition and scalar multiplication and we shall see what the corresponding matrix operations are. We shall also see the matrix operation that represent the map operation of composition. And, we shall see how to find the matrix that represents a map's inverse. Exercises Problem 1 Decide if the vector is in the column space of the matrix. <li> , <li> , <li> , Problem 2 Decide if each vector lies in the range of the map from to represented with respect to the standard bases by the matrix. <li> , <li> , Problem 3 Consider this matrix, representing a transformation of , and these bases for that space. <li> To what vector in the codomain is the first member of mapped? <li> The second member? <li> Where is a general vector from the domain (a vector with components and ) mapped? That is, what transformation of is represented with respect to by this matrix? Problem 4 What transformation of is represented with respect to and by this matrix? Problem 5 Decide if is in the range of the map from to represented with respect to and by this matrix. Problem 6 Example 2.8 gives a matrix that is nonsingular, and is therefore associated with maps that are nonsingular. <li> Find the set of column vectors representing the members of the nullspace of any map represented by this matrix. <li> Find the nullity of any such map. <li> Find the set of column vectors representing the members of the rangespace of any map represented by this matrix. <li> Find the rank of any such map. <li> Check that rank plus nullity equals the dimension of the domain. Problem 7 Because the rank of a matrix equals the rank of any map it represents, if one matrix represents two different maps (where ) then the dimension of the rangespace of equals the dimension of the rangespace of . Must these equal-dimensioned rangespaces actually be the same? Problem 8 Let be an -dimensional space with bases and . Consider a map that sends, for , the column vector representing with respect to to the column vector representing with respect to . Show that is a linear transformation of . Problem 9 Example 2.2 shows that changing the pair of bases can change the map that a matrix represents, even though the domain and codomain remain the same. Could the map ever not change? Is there a matrix , vector spaces and , and associated pairs of bases and (with or or both) such that the map represented by with respect to equals the map represented by with respect to ? Problem 10diagonal matrix A square matrix is a diagonal matrix if it is all zeroes except possibly for the entries on its upper-left to lower-right diagonal— its entry, its entry, etc. Show that a linear map is an isomorphism if there are bases such that, with respect to those bases, the map is represented by a diagonal matrix with no zeroes on the diagonal. Problem 11 Describe geometrically the action on of the map represented with respect to the standard bases by this matrix. Do the same for these. Problem 12 The fact that for any linear map the rank plus the nullity equals the dimension of the domain shows that a necessary condition for the existence of a homomorphism between two spaces, onto the second space, is that there be no gain in dimension. That is, where is onto, the dimension of must be less than or equal to the dimension of . <li> Show that this (strong) converse holds: no gain in dimension implies that there is a homomorphism and, further, any matrix with the correct size and correct rank represents such a map. <li> Are there bases for such that this matrix represents a map from to whose range is the plane subspace of ? Problem 13 Let be an -dimensional space and suppose that . Fix a basis for and consider the map given by the dot product. <li> Show that this map is linear. <li> Show that for any linear map there is an such that . <li> In the prior item we fixed the basis and varied the to get all possible linear maps. Can we get all possible linear maps by fixing an and varying the basis? Problem 14 Let be vector spaces with bases . <li> Suppose that is represented with respect to by the matrix . Give the matrix representing the scalar multiple (where ) with respect to by expressing it in terms of . <li> Suppose that are represented with respect to by and . Give the matrix representing with respect to by expressing it in terms of and . <li> Suppose that is represented with respect to by and is represented with respect to by . Give the matrix representing with respect to by expressing it in terms of and . /Solutions/ Linear Algebra Any Matrix Represents a Linear Map Representing Linear Maps with Matrices Matrix Operations