Truncation, Rounding, Overflow and Under Flow

Get Revising

Created by: mrkhan
Created on: 04-10-13 09:54

Truncation

This method ignores all information beyond a given number of decimal places (or significant figures)

1 of 7

Example - 5.26 ......................... to one decimal place is 5.2

Example - 53,729 ................. to 2 significant figures is 53,000

2 of 7

Rounding

This method takes the nearest number with the given number of decimal places (or significant figures)

3 of 7

Example - 5.26 .................... to one decimal place is 5.3

Example - 53,729 ..................... to 2 significant figures is 54,000

4 of 7

Overflow

This is caused when a number is too large to be stored accurately in the reserved storage space. It is usually the result of a numerical calculation.

5 of 7

Example- We have 4 bits (Unsigned) to store result of the calculation 6*3 = 18. .................... has occured because we can only represent 15 max in 4 bits.

Underflow

6 of 7

This is caused when a number is too small to be represented in the storage space reserved for it.

Example - We have 4 bits (Unsigned, fixed point decimal method at 2 bits) to store 0.125. ................ has occured as we can only store 0.25 minimum.

7 of 7

Other cards in this set

Card 2

Front

Example - 5.26 ......................... to one decimal place is 5.2

Back

Example - 53,729 ................. to 2 significant figures is 53,000

Card 3

Front

Rounding

Back

Card 4

Front

Example - 5.26 .................... to one decimal place is 5.3

Back

Card 5

Front

Overflow

Back

View more cards

Get Revising

Truncation, Rounding, Overflow and Under Flow