FloatingPointRepresentation

In the case of the parallel resistance formula this

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: e parallel resistance formula this leads to a nal correct result of 1=1 = 0. It is, of course, true that a 0 has the value 0 for any nite value of a. Similarly, we can adopt the convention that a=0 = 1 for any positive value of a. Multiplication with 1 also makes sense: a 1 has the value 1 for any positive value of a. But the expressions 1 0 and 0=0 make no mathematical sense. An attempt to compute either of these quantities is called an invalid operation, and the IEEE standard calls for the result of such an operation to be set to NaN (Not a Number). Any arithmetic operation on a NaN gives a NaN result, so any subsequent computation with expressions which have a NaN value are themselves assigned a NaN value. When a NaN is discovered in the output of a program, the programmer knows something has gone wrong and can invoke debugging tools to determine what the problem is. This may be assisted by the fact that the bitstring in the fraction eld can be used to code the origin of the NaN. Consequently, we...
View Full Document

This note was uploaded on 02/12/2014 for the course MATH 4800 taught by Professor Lie during the Spring '09 term at Rensselaer Polytechnic Institute.

Ask a homework question - tutors are online