I want to understand the actual difference between float16
and float32
in terms of the result precision. For instance, Numpy
allows you to choose the range of the datatype you want (np.float16, np.float32, np.float64)
. My concern is that if I decide to go with float 16 to reserve memory and avoid possible overflow, would that create a loss of the final results comparing with float32 for instance?
Thank you
float16
is only very rarely used. Most popular programming languages do not support it. Thefloat
/double
in Java for instance correspond tonp.float32
andnp.float64
...