fitSharp
Floating Point Handler
The Floating Point Handler compares floating point numbers using "visual" precision, i.e., numbers that display as the same string are considered equal. This is one way of dealing with floating point rounding issues that can cause apparently correct results to be marked as incorrect.

story test fixture

checktest result
sample do
checkdivide float130.3333333
checkdivide double130.333333333333333

configuration setup
service
add operatorfitSharp.Fit.Operators.CompareFloatingPoint

sample do
checkdivide float130.3333333
checkdivide double130.333333333333333
sample do
checkdivide float130.3333333 expected
0.3333333 actual
checkdivide double130.333333333333333 expected
0.333333333333333 actual

configuration setup
service
add operatorfitSharp.Fit.Operators.CompareFloatingPoint

sample do
checkdivide float130.3333333
checkdivide double130.333333333333333
© Copyright Syterra Software Inc. All rights reserved.