floats are fuzzy around the edges and not "dense" enough

  • Never do: "The difference between two floats is equal to..."
  • Do: "The difference between two floats is in the range ..."
    • But even 2 needs some serious thinking if the range of float values being compared is large.
here is error and What Every Computer Scientist Should Know About Floating-Point Arithmetic


Page Information

  • 7 months ago [history]
  • View page source
  • You're not logged in
  • No tags yet learn more

Wiki Information

Recent PBwiki Blog Posts