# Accurate Sum and Dot Product

@article{Ogita2005AccurateSA, title={Accurate Sum and Dot Product}, author={Takeshi Ogita and Siegfried M. Rump and Shin'ichi Oishi}, journal={SIAM J. Sci. Comput.}, year={2005}, volume={26}, pages={1955-1988} }

Algorithms for summation and dot product of floating-point numbers are presented which are fast in terms of measured computing time. We show that the computed results are as accurate as if computed in twice or K-fold working precision, $K\ge 3$. For twice the working precision our algorithms for summation and dot product are some 40% faster than the corresponding XBLAS routines while sharing similar error estimates. Our algorithms are widely applicable because they require only addition…

## Figures, Tables, and Topics from this paper

## 385 Citations

Accurate summation, dot product and polynomial evaluation in complex floating point arithmetic

- Mathematics, Computer ScienceInf. Comput.
- 2012

This paper provides new algorithms which deal with complex floating point numbers and shows that the computed results are as accurate as if computed in twice the working precision.

Accurate Floating-Point Product and Exponentiation

- Computer ScienceIEEE Transactions on Computers
- 2009

A method to improve the accuracy of the product of floating-point numbers is focused on and it is shown that the computed result is as accurate as if computed in twice the working precision.

Parallel algorithms for accurate sum and dot product on GPU

- Computer Science
- 2009

An efficient data parallel algorithm applying the all-prefix-sums operation (or the parallel reduction, more simply) suitable for multicore processors, especially GPUs is developed.

Choosing a twice more accurate dot product implementation

- Computer Science
- 2006

It is shown that the FMA does not improve in a significant way the accuracy of the result whereas it increases significantly the actual speed of the algorithms.

Accurate Floating Point Product

- Mathematics
- 2008

Several different techniques and softwares intend to improve the accuracy of results computed in a fixed finite precision. Here we focus on a method to improve the accuracy of the product of floating…

A new architecture for accurate dot product of floating point numbers

- Computer ScienceThe 2010 International Conference on Computer Engineering & Systems
- 2010

This paper introduces an efficient hardware implementation for accurate dot product that was configured as a custom instruction in the ALTERA NiosII soft processor core and is as accurate as other algorithms and faster than them.

A Correctly-Rounded Fixed-Point-Arithmetic Dot-Product Algorithm

- Computer Science2020 IEEE 27th Symposium on Computer Arithmetic (ARITH)
- 2020

This article describes an algorithm that computes a correctly-rounded sum of products from inputs whose format is known in advance, and relies on odd rounding (that is easily implemented in hardware) and comes with a careful proof and some cost analysis.

Enhanced Floating-Point Sums, Dot Products, and Polynomial Values

- Computer Science
- 2010

In this chapter, we focus on the computation of sums and dot products, and on the evaluation of polynomials in IEEE 754 floating-point arithmetic.1 Such calculations arise in many fields of numerical…

Accurate Floating Point Arithmetic through Hardware Error-Free Transformations

- Computer ScienceARC
- 2011

It is shown that the time×area product can be improved by a factor of 4 and 6 over software error-free addition and multiplication and it is illustrated that a number of area and performance trade-offs can be made when calculating vector sums and dot products.

Correctly rounded architectures for Floating-Point multi-operand addition and dot-product computation

- Computer Science2013 IEEE 24th International Conference on Application-Specific Systems, Architectures and Processors
- 2013

This study presents hardware architectures performing correctly rounded Floating-Point (FP) multioperand addition and dot-product computation, both of which are widely used in various fields, such as…

## References

SHOWING 1-10 OF 53 REFERENCES

Accurate and Efficient Floating Point Summation

- Mathematics, Computer ScienceSIAM J. Sci. Comput.
- 2004

Several simple algorithms for accurately computing the sum of n floating point numbers using a wider accumulator are presented and how the cost of sorting can be reduced or eliminated while retaining accuracy is investigated.

A Distillation Algorithm for Floating-Point Summation

- Mathematics, Computer ScienceSIAM J. Sci. Comput.
- 1999

This paper describes an efficient "distillation" style algorithm which produces a precise sum by exploiting the natural accuracy of compensated cancellation, applicable to all sets of data but particularly appropriate for ill-conditioned data.

Floating-point computation of functions with maximum accuracy

- Mathematics, Computer Science1975 IEEE 3rd Symposium on Computer Arithmetic (ARITH)
- 1975

Algorithms are given which compute multiple sums and products and arbitray roots of floating-point numbers with maximum accuracy and simple error formulas and the smallest floating- point intervals containing the exact result can be obtained.

Algorithms for arbitrary precision floating point arithmetic

- Mathematics, Computer Science[1991] Proceedings 10th IEEE Symposium on Computer Arithmetic
- 1991

The author presents techniques for performing computations of very high accuracy using only straightforward floating-point arithmetic operations of limited precision, and an algorithm is presented which computes the intersection of a line and a line segment.

Adaptive Precision Floating-Point Arithmetic and Fast Robust Geometric Predicates

- Mathematics, Computer ScienceDiscret. Comput. Geom.
- 1997

This article offers fast software-level algorithms for exact addition and multiplication of arbitrary precision floating-point values and proposes a technique for adaptive precision arithmetic that can often speed these algorithms when they are used to perform multiprecision calculations that do not always require exact arithmetic, but must satisfy some error bound.

Scalar fused multiply-add instructions produce floating-point matrix arithmetic provably accurate to the penultimate digit

- Mathematics, Computer ScienceTOMS
- 2003

Combined with doubly compensated summation, scalar fused multiply-add instructions redefine the concept of floating-point arithmetic, because they allow for the computation of sums of real or complex…

Software for Doubled-Precision Floating-Point Computations

- Computer ScienceTOMS
- 1981

A modffication of Dekker's method is presented and is proved to be valid in most existing arithmetics, while the original method is valid only in a qmte restricted class of anthmetms.

The Accuracy of Floating Point Summation

- Mathematics, Computer ScienceSIAM J. Sci. Comput.
- 1993

Five summation methods and their variations are analyzed here and no one method is uniformly more accurate than the others, but some guidelines are given on the choice of method in particular cases.

A floating-point technique for extending the available precision

- Computer Science, Mathematics
- 1970

A technique is described for expressing multilength floating-point arithmetic in terms of singlelength floating point arithmetic, i.e. the arithmetic for an available (say: single or double…

Semantics for exact floating point operations

- Mathematics, Computer Science[1991] Proceedings 10th IEEE Symposium on Computer Arithmetic
- 1991

Semantics are given for the four elementary arithmetic operations and the square root, to characterize what are termed exact floating point operations, which make it possible to realize the following principle: it shall be a user option to discard any information in the result of a floating point arithmetic operation.