PRB: Inaccurate Representation of Large Double Values (59407)
The information in this article applies to:
- Microsoft C for MS-DOS
- Microsoft C for OS/2
- Microsoft Visual C++ for Windows, 16-bit edition 1.0
- Microsoft Visual C++ for Windows, 16-bit edition 1.5
- Microsoft Visual C++, 32-bit Editions 1.0
- Microsoft Visual C++, 32-bit Editions 2.0
- Microsoft Visual C++, 32-bit Editions 4.0
- Microsoft Visual C++, 32-bit Editions 5.0
- Microsoft Visual C++, 32-bit Editions 6.0
This article was previously published under Q59407 SYMPTOMS
In Microsoft C, subtracting double values greater than or equal to
1.0E+025 may return inaccurate results.
CAUSE
This is expected behavior and is due to the imprecise nature of
floating-point math. Anytime floating-point math uses large numbers,
there will be rounding/truncation errors and errors introduced due to
imprecise representation of a result in binary format.
Modification Type: | Minor | Last Reviewed: | 7/5/2005 |
---|
Keywords: | kbCompiler kbprb KB59407 |
---|
|