Doubly Recursive Multivariate Automatic Differentiation

  title={Doubly Recursive Multivariate Automatic Differentiation},
  author={Dan Kalman},
  journal={Mathematics Magazine},
  pages={187 - 202}
  • D. Kalman
  • Published 1 June 2002
  • Computer Science
  • Mathematics Magazine
system. That's right. The automatic differentiation system never formulates a symbolic expression for the derivative. Automatically calling on something like Mathematica to produce a symbolic derivative, and then plugging in a value for x is the wrong image entirely. Automatic differentiation is something completely different. Well OK, but so what? Symbolic algebra systems are so prevalent and powerful today, why should we be concerned with avoiding symbolic methods? There are two answers. The… 

A Consistent and Categorical Axiomatization of Differentiation Arithmetic Applicable to First and Higher Order Derivatives

This article aims at recasting real differentiation arithmetic in a formalized theory of dyadic real differentiation numbers that provides a foundation for first and higher order automatic derivatives.

Automatic differentiation for propagation of orbit uncertainties on Orekit

Automatic differentiation has been developed as a mathematical tool to avoid the calculations of the derivatives of long equations and is adaptable to a lot of situations, it just needs an implementation of f(x), various points to evaluate the derivative and few more things.

Algorithm Differentiation in Lisp: ADIL

In spite of the brevity and extensibility of the ADIL program, the perspective here is to point out that for scientists who write programs in Lisp or any language that can be converted to Lisp, AD is easily at hand.

The Principles of First Order Automatic Differentiation

This article provides a short overview of the theory of First Order Automatic Differentiation (AD) for readers unfamiliar with this topic. In particular, we summarize different characterisations of

A Hitchhiker’s Guide to Automatic Differentiation

An overview of some of the mathematical principles of Automatic Differentiation is provided, like the matrix-vector product based approach, the idea of lifting functions to the algebra of dual numbers, the method of Taylor series expansion on dual numbers and the application of the push-forward operator.

Principles of Automatic Differentiation

Different descriptions of the Forward Mode of AD, like the matrix-vector product based approach, the idea of lifting functions to the algebra of dual numbers, the method of Taylor series expansion on dual numbers and the application of the push-forward operator are summarised.

An algorithm for discovering Lagrangians automatically from data

An algorithm is presented that automates the model building process in a scientifically principled way and can take observed trajectories from a wide variety of mechanical systems and predict the future evolution of the system.

Modular Compilation for a Hybrid Non-Causal Modelling Language

This work introduces a technique the authors call order-parametric differentiation to allow truly modular compilation of a hybrid non-causal language and develops a compilation scheme that enables using partial models as first-class objects in a seamless way and simulating them without the need for just-in-time compilation, even in the presence of structural dynamism.

Improve GNSS Orbit Determination by using Estimated Tropospheric and Ionospheric Models

It is addressed that estimated tropospheric and ionospheric models are actually more accurate than empirical models to estimate satellite state vector in GNSS orbit determination.

Operational Semantics for a Modular Equation Language

T, a language which aims to overcome deficiency in equation–based object–oriented modeling languages by using automatic differentiation directly in the language semantics, has the ability to implement index-reduction and causalisation of equation-terms without knowing their source-level representation.



The Arithmetic of Differentiation

Abstract : This report describes automatic differentiation, which is neither symbolic nor approximate, for single functions of one real variable. The rules of evaluation and differentiation are

Evaluating derivatives - principles and techniques of algorithmic differentiation, Second Edition

This second edition has been updated and expanded to cover recent developments in applications and theory, including an elegant NP completeness argument by Uwe Naumann and a brief introduction to scarcity, a generalization of sparsity.

An efficient method for the numerical evaluation of partial derivatives of arbitrary order

The key ideas are a hyperpyramid data structure and a generalized Leibniz's rule which produces any partial derivative by forming the minimum number of products (between two lower partials) together with a product of binomial coefficients.

A recursive approach to multivariate automatic differentiation

In one approach to automatic differentiation, the range of a function is generalized from a single real value to an aggregate representing the values of the function and one or more derivatives. The

and A

  • Griewank, Structured second- and higher-order derivatives through univariate Taylor series, preprint MCS-P296-0392, Argonne National Laboratory, Argonne, Illinois, May
  • 1992

Recursive multivariate automatic differentiation, Optimization

  • Methods and Software
  • 1995

Automatic differentiation of composite functions, in Automatic Differentiation of Algorithms: Theory, Implementation, and Application, A

  • Griewank and G. F. Corliss, eds., SIAM, Philadelphia,
  • 1991

Structured second-and higher-order derivatives through univariate Taylor series

This work computes derivatives in a fashion that parallelizes well, exploits sparsity or other structure frequently found in Hessian matrices, can compute only selected elements of a Hessian matrix, and computes Hessian × vector products.

Flanders , Automatic differentiation of composite functions , in Automatic Differentiation of Algorithms : Theory , Implementation , and Application , A . Griewank and

  • 1992