10/22/2018 5:00 PM | |
Joined: 3/12/2015 Last visit: 7/17/2024 Posts: 533 Rating: (15) |
|
10/22/2018 10:54 PM | |
Joined: 7/7/2010 Last visit: 9/20/2024 Posts: 15211 Rating: (2417)
|
This is an interesting read and may help you understand the problems with floating point numbers. http://www.phys.uconn.edu/~rozman/Courses/P2200_15F/downloads/floating-point-guide-2015-10-15.pdf
|
science guy |
|
This contribution was helpful to2 thankful Users |
10/23/2018 11:24 AM | |
Joined: 3/5/2014 Last visit: 8/5/2022 Posts: 5521 Rating: (1054)
|
hi jackcaress, there are also FAQ that are showing the error in floating-point operations: How accurately can I calculate with REAL numbers that are used in extensive formulas? hope this helps, regards |
FCK WAR! |
|
This contribution was helpful to2 thankful Users |
Follow us on