Truncation, Rounding, Overflow and Under Flow

HideShow resource information
Truncation
This method ignores all information beyond a given number of decimal places (or significant figures)
1 of 7
Example - 5.26 ......................... to one decimal place is 5.2
Example - 53,729 ................. to 2 significant figures is 53,000
2 of 7
Rounding
This method takes the nearest number with the given number of decimal places (or significant figures)
3 of 7
Example - 5.26 .................... to one decimal place is 5.3
Example - 53,729 ..................... to 2 significant figures is 54,000
4 of 7
Overflow
This is caused when a number is too large to be stored accurately in the reserved storage space. It is usually the result of a numerical calculation.
5 of 7
Example- We have 4 bits (Unsigned) to store result of the calculation 6*3 = 18. .................... has occured because we can only represent 15 max in 4 bits.
Underflow
6 of 7
This is caused when a number is too small to be represented in the storage space reserved for it.
Example - We have 4 bits (Unsigned, fixed point decimal method at 2 bits) to store 0.125. ................ has occured as we can only store 0.25 minimum.
7 of 7

Other cards in this set

Card 2

Front

Example - 5.26 ......................... to one decimal place is 5.2

Back

Example - 53,729 ................. to 2 significant figures is 53,000

Card 3

Front

Rounding

Back

Preview of the front of card 3

Card 4

Front

Example - 5.26 .................... to one decimal place is 5.3

Back

Preview of the front of card 4

Card 5

Front

Overflow

Back

Preview of the front of card 5
View more cards

Comments

No comments have yet been made

Similar Computing resources:

See all Computing resources »See all Fundamentals of computer systems resources »