Right, when I was doing a math Ph.D my specialization was numerical optimization. One of the first classes was numerical linear algebra. Of course you shouldn't be inverting a matrix if you don't have to. But this is basic stuff you can read in any numerical linear algebtra textbook.