[fpc-pascal] fpc 32 / 64 bit / c++/ floating point question
    Marco van de Voort 
    marcov at stack.nl
       
    Sun Nov 21 21:13:46 CET 2010
    
    
  
In our previous episode, Vinzent H?fler said:
> <mueller_michael at alice-dsl.net> wrote:
> 
> > Single has 7 significant digits.
> 
> <mode style="nitpicking">
> Six significant digits. The seventh already is unreliable.
> </mode>
A mistake in the nth digit can show up much higher than the nth or n-1th
digit, depending on the magnitude of the condition number.  
A commonly known case of an error in inputs propagating to large errors in
output is catastrophic cancellation, which can cause a
condition number >>1.  And the example _does_ add negative values to
positive ones, which is equal to the subtraction in catastrophic
canellation.
    
    
More information about the fpc-pascal
mailing list