Corpus ID: 15971655

# Old and New Matrix Algebra Useful for Statistics

@inproceedings{Minka2000OldAN,
title={Old and New Matrix Algebra Useful for Statistics},
author={Thomas P. Minka},
year={2000}
}
The partials with respect to the numerator are laid out according to the shape of Y while the partials with respect to the denominator are laid out according to the transpose of X. For example, dy/dx is a column vector while dy/dx is a row vector (assuming x and y are column vectors—otherwise it is flipped). Each of these derivatives can be tediously computed via partials, but this section shows how they instead can be computed with matrix manipulations. The material is based on Magnus and… Expand
131 Citations
Patterned complex-valued matrix derivatives
• Mathematics
• 2008 5th IEEE Sensor Array and Multichannel Signal Processing Workshop
• 2008
A systematic and simple method is proposed for how to find the derivative of complex-valued matrix functions which depend on matrix arguments that contain patterns. The proposed method is developedExpand
An extended collection of matrix derivative results for forward and reverse mode algorithmic dieren tiation
This paper collects together a number of matrix derivative results which are very useful in forward and reverse mode algorithmic differentiation (AD). It highlights in particular the remarkableExpand
Efficient Automatic Differentiation of Matrix Functions
• Physics
• 2012
Forward and reverse mode automatic differentiation methods for functions that take a vector argument make derivative computation efficient. However, the determinant and inverse of a matrix are notExpand
Towards a Unified Framework of Matrix Derivatives
• Computer Science
• IEEE Access
• 2018
This paper establishes a sufficient condition under which not only the first approach can be applied but also the time complexity of results obtained from the second approaches can be reduced, and enables the framework of matrix derivatives, which would result in various applications in science and engineering. Expand
Hessians of scalar functions of complex-valued matrices: A systematic computational approach
• Mathematics, Computer Science
• 2007 9th International Symposium on Signal Processing and Its Applications
• 2007
It is shown how the four Hessian matrices of a scalar complex function can be identified from the second-order complex differential of the scalar function. Expand
What is the gradient of a scalar function of a symmetric matrix ?
• Mathematics, Computer Science
• ArXiv
• 2019
It is demonstrated that the relation between the gradient of a real-valued function of a symmetric matrix and the definition of a \frechet derivative is incorrect, and it is proved that G_s = \mathrm{sym}(G)\$. Expand
A note on matrix differentiation
This paper presents a set of rules for matrix differentiation with respect to a vector of parameters, using the flattered representation of derivatives, i.e. in form of a matrix. We also introduce aExpand
Vector and Matrix Calculus
• H. Kamper
• Theoretical and Mathematical Physics
• 2018
As explained in detail in , there unfortunately exists multiple competing notations concerning the layout of matrix derivatives. This can cause a lot of difficulty when consulting several sources,Expand
A note on differentiating matrices
This paper presents a set of rules for matrix differentiation with respect to a vector of parameters, using the flattered representation of derivatives, i.e. in form of a matrix. We also introduce aExpand
Complex-Valued Matrix Differentiation: Techniques and Key Results
• Mathematics, Computer Science
• IEEE Transactions on Signal Processing
• 2007
In the framework introduced, the differential of the complex-valued matrix function is used to identify the derivatives of this function and Matrix differentiation results are derived and summarized in tables. Expand