 |
| ||
| |||
|
| Math Central | Quandaries & Queries |
|
Question from Randy: Hi, On your calculator I found that a box 10 by 10 by 10 inches has a volume of 1,000.0000000000001 cubic inches. Can you explain the numeral 1 thirteen places past the decimal? Thanks, Randy |
Hi Randy,
Did you use our volume calculator? If so what did you input? I haven't been able to duplicate your result.
The digit 1 in the thirteenth place after the decimal is probably round off error that results from the way that computers store numbers and do arithmetic. If you use our Volume Calculator you will see the note "calculations accurate to 5 decimal places of precision".
Penny
| ||
| ||
| ||
 |
 |
|
Math Central is supported by the University of Regina and The Pacific Institute for the Mathematical Sciences.