com.aspose.cells

com.aspose.cells

Class CalculationPrecisionStrategy

  • java.lang.Object
    • com.aspose.cells.CalculationPrecisionStrategy
public class CalculationPrecisionStrategy 
extends java.lang.Object

Utility class containing constants. Enumerates strategies for handling calculation precision. Because of the precision issue of IEEE 754 Floating-Point Arithmetic, some "seemingly simple" formulas may not be calcualted as the expected result. Such as formula "=-0.45+0.43+0.02", when calcuating operands by '+' operator directly, the result is not zero. For such kind of precision issue, some special strategies may give the expected result.

Field Summary
static final intNONE
No strategy applied on calculation. When calculating just use the original double value as operand and return the result directly. Most efficient for performance and applicable for most cases.
static final intROUND
Rounds the calculation result according with significant digits.
static final intDECIMAL
Uses decimal as operands when possible. Most inefficient for performance.
 

    • Field Detail

      • NONE

        public static final int NONE
        No strategy applied on calculation. When calculating just use the original double value as operand and return the result directly. Most efficient for performance and applicable for most cases.

      • ROUND

        public static final int ROUND
        Rounds the calculation result according with significant digits.

      • DECIMAL

        public static final int DECIMAL
        Uses decimal as operands when possible. Most inefficient for performance.