We had a discussion about floating point arithmetic on 32-bit processors in our team this morning: here's a brief note I made on the subject a long time ago. double a = 95.0; double b = 94.0001; double c = a – b; In .Net this give c = 0.99989999999999668. It should be 0.9999 obviously. This … Continue reading Floating Point Arithmetic
Rich Newman 