Notice: This website is an unofficial Microsoft Knowledge Base (hereinafter KB) archive and is intended to provide a reliable access to deleted content from Microsoft KB. All KB articles are owned by Microsoft Corporation. Read full disclaimer for more details.

XL2000: CONVERT Function Returns Incorrect Calculation for Liters and Quarts


View products that this article applies to.

This article was previously published under Q283695

↑ Back to the top


Symptoms

When you use the CONVERT function from the Analysis Toolpak to convert liters to quarts, or quarts to liters, the result is incorrect beyond the third decimal place.

↑ Back to the top


Cause

The Analysis Toolpak converts 1 liter to 1.056458333 quarts, but it should convert to 1.056689266 quarts.

The Analysis Toolpak converts 1 quart to 0.946558864 liters, but it should convert to 0.946352 liters.

↑ Back to the top


Workaround

To work around this problem, use the following formulas to change between liters and quarts:
Quarts = Liters*.946352
Liters = Quarts/.946352

↑ Back to the top


Status

Microsoft has confirmed that this is a problem in the Microsoft products that are listed at the beginning of this article.

↑ Back to the top


References

Based on the "Weights and Measures" table in the standard HA Webster's New Collegiate Dictionary:
1 gill = 4 fluidounces = 118.294 milliliters (ml)

1 quart = 32 fluidounces = 8 gills = 8 x 118.294 ml = 946.352 ml = 0.946352 liters (divide by 1,000 to convert ml to liters)

Therefore, 0.946352 liters = 1 quart.

Or, after you divide both sides by 0.946352:
1 liter = 1.056689 quarts.

This figure agrees with all commonly used conversion tables.

↑ Back to the top


Keywords: KB283695, kbpending, kbbug

↑ Back to the top

Article Info
Article ID : 283695
Revision : 3
Created on : 9/25/2003
Published on : 9/25/2003
Exists online : False
Views : 182