Section 11.3 Matrix Inverses
Now we come to the most useful property a matrix can have, to be invertible, meaning it has an inverse matrix. A system of linear equations only has a solution if, when it’s represented in a matrix, that matrix is invertible. Matrix inverses also allow faster solving of systems of linear equations. This property is crucial for many computer science applications, such as these from the Wikipedia article: Invertible matrix:
1
en.wikipedia.org/wiki/Invertible_matrix
- In computer graphics and image processing, invertible matrices are fundamental for transformations. Whether rotating, scaling, or translating images, these matrices facilitate seamless manipulation, contributing to the creation of visually appealing graphics.
- The world of cybersecurity relies on invertible matrices for encryption and decryption processes. Algorithms that involve matrix operations play a crucial role in securing sensitive information, making invertible matrices indispensable in cryptographic protocols.
- In finance, invertible matrices find applications in portfolio optimization. Efficiently managing diverse assets and risk requires mathematical models that involve invertible matrices, ensuring robust financial strategies.
- The backbone of many machine learning algorithms is formed by invertible matrices. From feature engineering to training models, these matrices contribute to the stability and efficiency of algorithms, enhancing predictive accuracy.
- In data science, invertible matrices are employed for dimensionality reduction techniques. Simplifying complex datasets without losing crucial information is achieved through the application of these matrices, aiding in more manageable and insightful analyses.
Subsection 11.3.1 Inverse Matrix
It is very important to observe that the inverse of a matrix, if it exists, is unique. Another way to think of this is that if it acts like the inverse, then it is the inverse.
Theorem 11.3.2.
Proof.
Unlike ordinary multiplication of numbers, it can happen that but may fail to have an inverse. This is illustrated in the following example.
Example 11.3.3. A matrix without an inverse.
Answer.
One might think would have an inverse because it does not equal zero. However,
and if existed, this could not happen because you could write
a contradiction. Thus the answer is that does not have an inverse.
Example 11.3.4. Showing a matrix is an inverse.
Answer.
To check this, multiply
and
showing that this matrix is indeed the inverse of
Subsection 11.3.2 Finding The Inverse Of A Matrix
This requires the solution to the systems of equations,
and
Writing the augmented matrix for these two systems gives
for the first system and
for the second. Let’s solve the first system. Take times the first row and add to the second to get
Now take times the second row and add it to the first to get
Now solve the second system, ((11.3.2)) to find and Take times the first row and add to the second to get
Now take times the second row and add it to the first to get
Didn’t the above seem rather repetitive? Note that exactly the same row operations were used in both systems. In each case, the end result was something of the form where is the identity and gave a column of the inverse. In the above, the first column of the inverse was obtained first and then the second column
To simplify this procedure, you could have written
and row reduced until you obtained
and read off the inverse as the matrix on the right side.
This is the reason for the following simple procedure for finding the inverse of a matrix. This procedure is called the Gauss-Jordan procedure.
Definition 11.3.5. Gauss-Jordan Procedure.
and then, if possible do row operations until you obtain an matrix of the form
When this has been done, If it is impossible to row reduce to a matrix of the form then has no inverse.
Actually, all this shows is how to find a right inverse if it exists. Later it will be shown that the right inverse is the inverse. See the Elementary Linear Algebra book at http://www.Saylor.org. for proof of this.
2
Example 11.3.6. Using Gauss-Jordan to find a matrix inverse.
Answer.
Set up the augmented matrix
Next take times the first row and add to the second followed by times the first row added to the last. This yields
Then take 5 times the second row and add to -2 times the last row
Next take the last row and add to times the top row. This yields
Now take times the second row and add to the top.
Finally divide the top row by the second row by and the bottom row by 14 which yields
Therefore, the inverse is
Example 11.3.7. Gauss-Jordan on a matrix with no inverse.
Answer.
Write the augmented matrix
and proceed to do row operations attempting to obtain . Take (-1) times the top row and add to the second. Then take (-2) times the top row and add to the bottom.
Next add (-1) times the second row to the bottom row.
At this point, you can see there will be no inverse because you have obtained a row of zeros in the left half of the augmented matrix . Thus there will be no way to obtain on the left.
Example 11.3.8. Checking Gauss-Jordan outcome correctness.
Answer.
Form the augmented matrix
Now do row operations until the matrix on the left becomes the identity matrix. This yields after some computations,
and so the inverse of A is the matrix on the right,
Checking the answer is easy. Just multiply the matrices and see if it works.
Always check your answer because if you are like some of us, you will usually have made a mistake.
Example 11.3.9. Solving systems of equations with a matrix inverse.
In this example, it is shown how to use the inverse of a matrix to find the solution to a system of equations. Consider the following system of equations. Use the inverse of a suitable matrix to give the solutions to this system.
The system of equations can be written in terms of matrices as
More simply, this is of the form Suppose you find the inverse of the matrix . Then you could multiply both sides of this equation by to obtain
This gives the solution as Note that once you have found the inverse, you can easily get the solution for different right hand sides without any effort. It is always just In the given example, the inverse of the matrix is
This was shown above in Example 11.3.8. Therefore, from what was just explained, the solution to the given system is
What would be the solution to
By the above discussion, it is just
This illustrates why once you have found the inverse of a given matrix, you can use it to solve many different systems easily.
Exercises 11.3.3 Exercises
1.
Answer.
Set up augmented matrix to use Gauss-Jordan:
Multiply row 2 by 2:
Add row 1 to row 2:
Divide row 2 by 7:
Subtract row 2 from row 1:
Divide row 1 by 2:
The inverse is the matrix on the right:
Check by multiplying the inverse with the original matrix:
Which is what we want.
2.
3.
Answer.
Set up augmented matrix to use Gauss-Jordan:
Subtract 3 times row 1 from 2 times row 2
Divide row 2 by -3
Subtract row 2 from row 1
Divide row 1 by 2
So the inverse matrix is
Check by multiplying the inverse with the original matrix:
Which is what we want.
4.
5.
Answer.
Set up augmented matrix to use Gauss-Jordan:
Row 3 - 4* row 1:
Row 2 - 2* row 1:
Row 3 - row 2:
There is no inverse. The left side cannot be made into
6.
7.
Answer.
Set up augmented matrix to use Gauss-Jordan:
Now perform row operations: Row 2 - 2 * row 1
Row 3 - row 1
Row 2
Row 3 row 2
Row 3
Row 1 row 3
Row 2 row 3
Row 1 row 2
The inverse matrix is
Therefore, the solution is
8.
9.
Answer.
We have already calculated the inverse for this matrix above in Exercise 7, it is
Solving for