Hi experts

I am facing a similar problem, output of th vacuum gauge is 0-10V, I need to scale from 5x10^-3 to 10^-11, I am using FC105 function for scaling but the value does not reached to 10^-11 for 27648 integer.

Thanking for the earliest response.

Dani

----------------------------------------------------------------------------------------------------
Split from displaying exponential in wincc.

U_746e7102-01f6-40fd-9940-1e7feca1eca4

Hi experts

I am facing a similar problem, output of th vacuum gauge is 0-10V, I need to scale from 5x10^-3 to 10^-11, I am using FC105 function for scaling but the value does not reached to 10^-11 for 27648 integer.

Thanking for the earliest response.

Dani

 Hello,

This operation is not possible to be processed accurately due to limitation in calculation of real numbers.Read more here:

How accurately can I calculate with REAL numbers that are used in extensive formulas?

I hope this helps,

hdhosseini