There are several labs operating throughout the world that do not follow a designated guideline for calculating measurement uncertainty for force calibrations. Realizing the need for guidance, Morehouse decided to draft this document explaining how to calculate measurement uncertainty and how uncertainty propagation for force calibration systems works.
Calibration and utilization of measurement instruments will imply some level of uncertainty. As an instrument calibration is traced back to SI units, a higher number of intermediate calibration stages results in higher levels of measurement uncertainty (Figure 1). In other words, uncertainty of the unit under test is typically higher than the standard with which it was calibrated. It is not possible for the expanded measurement uncertainty of the unit being calibrated to be less than the machine or force measuring device that is used to calibrate the unit itself. This paper describes the propagation of uncertainties using Calibration and Measurement Capability (CMC) for force measurement instruments through the traceability chain to SI units.
Test Plan and Equipment
A 445 kN (100k lbf) Morehouse Ultra-Precision Load Cell was chosen for the testing plan. The calibration test setup is shown in Figure 2. The Morehouse load cell provides relatively high stability, resolution, and repeatability. Consequently, the testing plan represents an almost best-case scenario: the lowest level of Calibration and Measurement Capability (CMC) that a load cell user can achieve at each level of the traceability chain.
An 89 kN (20k lbf) test point was chosen for analysis based on historical data. This load point was chosen for studying the CMC propagation to follow the ILAC P14 requirements. Morehouse Ultra-Precision 445 kN (100k lbf) systems can often use this load cell in the Tier 2 group from 20% to 100% of capacity for force calibration purposes without switching standards. The reference standard of Tier 2 in this paper represents a load cell that is calibrated in accordance with ASTM E74 standard test method using other load cells with ASTM Class AA designation. Additionally, the 20% point represents a pivot point for achieving CMC of approximately 0.02% of applied force. At higher forces, the CMC is typically lower. However, at lower than 20% of capacity forces, CMC starts to increase; it continues to increase to the 10% and lower force points, where the CMC becomes higher than 0.05% of applied force. Therefore, it is often recommended that the end user in Tier 2 only uses the load cell from 20% through capacity in order to maintain CMC's better than 0.02% of applied force.
Tier 0: CMC for Primary Standards
In this tier, CMC for Morehouse's deadweight calibration systems was determined. Table 1 contains the uncertainty contributors for this calculation, along with their appropriate divisors. Testing was conducted based on United States customary units, and then converted to SI units in Table 1 to make it more tangible for international users. Degrees of freedom and coverage factors were calculated separately using the Welch-Satterthwaite equation. In this tier, Morehouse had the reference deadweights calibrated directly by N.I.S.T. These weights, pictured in Figure 3, were adjusted for the local gravity, material density, and air buoyancy, and their traceability is derived from the international prototype kilogram (SI unit symbol kg).
When the calibration was performed in a Morehouse deadweight machine, CMC was calculated using these weights. A repeatability study was conducted with three Morehouse load cells (445 kN; 111 kN; and 44 kN capacities) throughout the entire range of the machine. Morehouse's CMC resolution for 89 kN (20k lbf) load was used for UUT resolution in Tier 0 only. This value was determined based on a 111 kN (25k lbf) load cell with 4 mV/V output at capacity and 0.00001 mV/V readability.
The environment was controlled by better than ±1.0 °C, while the stability of the weights was calculated using historical values for the material and years of wear history from our other deadweight machines. The resolution of the weights was zero since they are physical standards, and the resolution of a good measurement system was used as an uncertainty contributor for UUT resolution. Various technicians' tests were compared to determine the repeatability and reproducibility per point of the Morehouse deadweight calibration machine. All of these efforts, combined with continued process monitoring, yielded a CMC of better than 0.0016% of applied force.
Tier 1: Using Primary Standard Deadweights to Calibrate a Load Cell
For Tier 1 calibration, the deadweight calibration machine was utilized to calibrate a load cell in accordance with the ASTM E74 standard. A Morehouse 445 kN (100k lbf) load cell was calibrated in this tier by deadweight primary standards known to have a CMC better than 0.016% of applied load.
To calculate the CMC of the calibration, a repeatability and reproducibility (R&R) study was done for Tier 1 using a 111 kN (25k lbf) Ultra-Precision load cell. Moreover, an environmental condition of ±1 degree Celsius, along with a stability value of 0.005% (50 parts per million), was used for calculating uncertainty values. The actual resolution of the UUT load cell 1.07 N (0.24 lbf) was employed for uncertainty calculations in Tier 1. It might be noteworthy to mention that the reference uncertainty used in Tier 1 already included the UUT resolution embedded in deadweight CMC calculations. Basically, UUT resolution is considered twice in the calculation of uncertainties for Tier 1–3. This method is on the conservative side of the uncertainty calculations, and there is ongoing debate about whether or not the resolution from CMC must be included in higher calibration tiers.
Load cell output stability is another of the uncertainty contributors when the cell is calibrated per ASTM E74. Stability is calculated by comparing the load cell output to the previous calibration data. Most Morehouse Ultra-Precision load cells provide a one year stability of around 0.005% through 0.01%. Typically, the actual numbers would be used for this evaluation; however, this test was controlled, and the experiment could not wait another year to obtain the actual UUT load cell's stability numbers.
Ideally, load must be applied to the primary loading axis of any load cell in order to produce most repeatable and accurate results. This primary loading axis for shear web load cells such as the one used in this study, generally falls on the axisymmetric axis of the cell. However, in reality, some side loading is traduced into the loading system which can influence the load cell output. Side loading on a shear web load cell is demonstrated in Figure 4. Morehouse Universal Calibrating Machine (UCM) can provide side loading of better than 1/16th of an inch. Additionally, the side load sensitivity of a Morehouse Ultra Precision load cell is 0.05% of load per inch of side loading. Multiplying 1/16th of an inch by 0.05% yielded an uncertainty contribution of 0.003% of applied load.
The ASTM E74 calibration and analysis results in a Lower Limit Factor (LLF), which is the standard deviation of variations in different runs multiplied by a coverage factor of 2.4. The UUT load cell in Tier 1 was assigned a Class AA loading range, which provides a test accuracy ratio (TAR) of better than 5:1 when used to calibrate another load cell in accordance with the ASTM E74 standard. In this range, the calibrated load cell (UUT) can be used to calibrate other load cells that will be used to calibrate force measuring or testing machines. As presented in Table 1, the expanded uncertainty for Tier 1 calibration was 0.01974% of applied force, or 17.57 N (3.95 lbf) at 89 kN (20k lbf) force. This value was applied as the reference uncertainty in Tier 2 calibration.
Tier 2: Using a Load Cell Calibrated by Primary Standards to Calibrate other Load Cells
In this tier, the Working Standard load cell was calibrated in accordance with the procedures outlined in the ASTM E74 standard. ASTM E74 fits the data points to a higher order curve using the least squares fit method. This is different than just linearizing a load cell. To run the test, a second Morehouse 100k lbf Ultra-Precision load cell was calibrated using the Morehouse Universal Calibrating Machine (UCM).
In Tier 2 Calibration, identical resolutions were used for both the reference cell and the Unit Under Test (UUT). The first Morehouse Ultra-Precision cell that was calibrated to primary standards in Tier 1 was employed in Tier 2 to calibrate the UUT (the second 445 kN Morehouse Ultra-Precision load cell). The CMC that resulted from Tier 1 calibration (17.57 N) was employed as the reference uncertainty at this level. The same uncertainty contributors were used and a new ASTM LLF was calculated.
Based on the calibration data, the LLF was calculated and an ASTM Class A loading range that provides a test accuracy ratio (TAR) of better than 4:1 was assigned*. This calibration produced a working standard with an assigned class A loading range. As shown in Table 1, the resulting expanded uncertainty for Tier 2 calibration is 0.031% of applied force, or 27.45 N (6.17 lbf) at 89 kN (20k lbf).
(*Note: Normal Metrology Practices Discourage TAR (ASTM E74 was developed in 1974 and still relies on a method using TAR where the maximum error of primary standards are to be no more than 0.005% of applied force, Secondary Class AA Standards are no more than 0.05% and Field Standards are no more than 0.25% . This equates to TAR's of 10:1, 5:1, and 4:1. Contemporary conventions of metrological science no longer focus on a TAR in establishing decision risk criteria. Most modern practices focus on TUR (Test Uncertainty Ratio) for a measure of adequate decision risk criteria.)
Tier 3: Using a Working Standard Load Cell to Calibrate Field Equipment
Tier 3 was meant to simulate the conditions of a field calibration test. In the ASTM E74 pyramid, the working standard that was calibrated in Tier 2 (accredited calibration supplier or secondary standard) could only be used to calibrate testing machines. However, the testing plan presented was conducted in a controlled laboratory environment to simulate the best-case scenario for uncertainty propagation. Thus, the same testing regime, with load cell and UCM, was followed for Tier 3. Nonetheless, an aircraft scale calibrator (such as Morehouse 804000) could have been used. For this calibration, the ASTM LLF was reduced to a pooled standard deviation to perform what would normally be the calibration of a testing machine. Since an identical setup as in Tier 2 was utilized for this test, the uncertainty contributors remained the same; however, the ASTM LLF increased again. The ASTM LLF increase was due to the higher expanded uncertainty bands of the reference.
Repeatability and Reproducibility (R & R) tests were conducted at each tier. In Tier 0, we used the same R & R values as reported in our CMC. In Tiers 1 through 3, we used a R & R study we conducted in house and repeated the number throughout tiers 1 through 3. The full explanation for B/W Techs Reproducibility and Repeatability can be found in section 7. We would expect the R & R between technicians to grow larger throughout the remaining tiers as well as the resolution of the Unit Under Test because the UUT's at each tier will typically be less accurate than what was used for these tests.
The uncertainty calculations in Table 1 resulted in CMC for Tier 3 equal to 0.106% of applied force at 89 kN (20k lbf). It might be worth mentioning that actual Tier 3 testing would produce much higher CMC than shown in Table 1 since the stability per point would most likely increase, as would the resolution of the UUT. It is important to note that the end calculation will inevitably be higher than what we have shown.
Based upon the testing information presented from and supported by years of testing, this summary should help guide users in determining what uncertainty they can obtain while using various force standards. If a CMC of better than 0.03% of applied force is desired, calibration by primary standards (deadweight) is necessary. Figure 5 illustrates the predicted minimum uncertainties that can be achieved by various laboratory tiers. The figure indicates that an additional reference standard would be needed at every 20% interval to maintain better than 0.02%. In other words, a 500-kN Universal Calibrating Machine would need reference standard load cells or proving rings with capacities of 445, 89, and 22 kN (100k, 20k, and 5k lbf respectively) to achieve 0.02% of applied load or better with a force range of 4.450 kN (1k lbf) through 445 kN (100k lbf).
The testing proved the importance of the reference standard in relation to overall expanded uncertainty. Deadweight primary standards are predictably the best possible reference standard. A laboratory using secondary standards—those standards calibrated by deadweight—can achieve CMC's as low as 0.02% of applied load if they are using several standards. Nonetheless, the downside of using several standards is that this method involves standards to be changed at least once during the calibration.
Laboratories that claim CMC's of 0.01% of applied or better may have to make three to four standard changes, or, they would need to have very expensive reference load cells and meters calibrated direct by a NMI such as N.I.S.T. These changes will add to the overall uncertainty of the force measuring instrumentation being calibrated. Standard changes take time, which often results in higher deviations between the test points calibrated with one standard when compared to the test points using the additional standard. This additional error is directly related to timing issues and often raises the ASTM LLF, which affects the Class A loading range. Therefore, if the end user wants the lowest possible loading range, it is recommended that calibration be performed using deadweight primary standards.
This article was written by Henry Zumbrun, President, and Ali Zeinali, Technical Director, Morehouse Instrument Company (York, PA). For more information, Click Here .
- ASTM E74-13a titled Standard Practice of Calibration of Force-Measuring Instruments for Verifying the Force Indication of Testing Machine.
- JCGM 100:2008 Evaluation of measurement data — Guide to the expression of uncertainty in measurement
- A2LA R205 - R205: Specific Requirements: Calibration Laboratory Accreditation Program
- ILAC P14:01/2013 Policy For Uncertainty in Calibration
- NCSLI RP-12: Determining and Reporting Measurement Uncertainties
- N.I.S.T Handbook 150-2016: NVLAP Procedures and General Requirements
- UKAS M3003: The Expression of Uncertainty and Confidence in Measurement