10/4/2012 3:26 PM | |
Joined: 10/7/2005 Last visit: 9/15/2024 Posts: 3020 Rating: (1054)
|
Hello cpender and just in case the previous answers are not satisfactory enough for you or your customer, you'llfind the "official" Siemens explanation in the FAQ below: How accurately can I calculate with REAL numbers that are used in extensive formulas? I hope this helps |
Cheers |
|
10/1/2013 2:24 PM | |
Joined: 1/5/2011 Last visit: 6/15/2024 Posts: 815 Rating: (122) |
Thanks for your reply manmeet, Can you explain why you quoted the following?
How come the error will come at this number? Can you provide me a example why starting from this number calculation are not accurate anymore? If its onlya 6decimal accuracy, then I'd think the error would come even earlier? By the way, I added aconversion of the number134217640.0 to a 32bit single precision float number (IEEE-754 1985 floating-point standard). Anyone intrested to take a look and tell me if it's correct? AttachmentFloatingpointno_IEEE745.zip (328 Downloads) |
Last edited by: Jens_app at: 10/1/2013 2:28 PMKeep it simple and on-topic. |
|
10/2/2013 8:55 AM | |
Joined: 7/18/2011 Last visit: 10/9/2023 Posts: 521 Rating: (91) |
Hi cpender Maybe you can take a look at this FAQ about 64bit numbers. Kind regards, BV |
4/13/2017 2:55 PM | |
Joined: 9/3/2014 Last visit: 3/13/2019 Posts: 4767 Rating: (123) |
New question published by norimane is split to a separate thread with the subject How to round REAL. Best regards |
Follow us on