Pediatric weight estimation: validation of the PAWPER XL tape and the PAWPER XL tape mid-arm circumference method in a South African hospital
Article information
Abstract
Objective
The primary aim of this study was to prospectively compare the performance of the Broselow tape, Mercy method, pediatric advanced weight prediction in the emergency room extra-long (PAWPER XL) tape, and PAWPER XL mid-arm circumference (MAC) method in estimating the weight of children from a low-income setting. The secondary aim was to analyze the time taken to perform each method.
Methods
This analyzed a convenience study sample of 300 children aged 0 to 18 years at the Baragwanath Hospital in South Africa. Weight estimations were obtained using each of the weight estimation systems on each child. These weight estimations were then compared against the actual weight to determine bias, precision, and accuracy of the estimation methods.
Results
The PAWPER XL tape and PAWPER XL-MAC methods performed the best and provided estimated weights within 10% of the actual weight in 62.7% and 67.3% of cases, respectively, followed by the Mercy method (56.5%) and Broselow tape (43.9%). The use of MAC improved the accuracy of estimation, especially in heavier and taller children. The median times taken to perform measurements using the Broselow tape, Mercy method, PAWPER XL tape, and PAWPER XL-MAC method were 11.3 seconds, 34.7 seconds, 9.3 seconds, and 33.9 seconds respectively.
Conclusion
The PAWPER XL tape and PAWPER XL-MAC methods were the most accurate methods of estimating weight in this group of children. These methods may be considered in preference to the Broselow tape or the Mercy method for emergency weight estimation in low socioeconomic status populations.
INTRODUCTION
The management directed at children is generally quantified by their body weight. The actual body weight of children presenting in emergency settings or receiving critical care is often difficult or impossible to obtain [1]. This is either due to the need for immediate intervention and resuscitation or due to immobilization. As the estimated body weight determines the efficacy and safety of therapeutic interventions, this estimation needs to be accurate [1,2].
Various length-based weight prediction methods have been developed for children in the past, the most well-known of which is the Broselow tape. This tape is commonly used in the emergency setting because of its simplicity and immediate availability of medication dosages and equipment sizes [3]. However, it also has significant disadvantages. Many studies have shown that the Broselow tape overestimates children’s weights in lower socioeconomic settings and underestimates the weight of children from higher income countries [4-7]. This can potentially lead to a dangerous degree of drug overdosing or underdosing.
Other than parental estimates, the most accurate current methods of weight estimation are the newer two-dimensional dual length- and body habitus-based systems, such as the Mercy method and the pediatric advanced weight prediction in the emergency room (PAWPER) tape system [8-10]. The Mercy method uses surrogates of the total body length (humeral length) and body habitus (mid-arm circumference, MAC) to estimate weight. This method has been shown to have good accuracy in populations with a high prevalence of obesity or of underweight children [11-14]. The PAWPER tape system makes use of a child’s body length and a general impression (gestalt visual assessment system) or a figural reference image rating scale (using pictures of children at each habitus score [HS]) to assess habitus and provide a weight estimation from the tape [15]. This system is potentially vulnerable to error as different health care workers may have different perceptions of body habitus [16]. For this reason, the PAWPER extra-long (XL)-MAC system was developed, which makes use of MAC to define body habitus, rather than a gestalt impression [17]. Since MAC has previously been shown to be strongly associated with body habitus and is an objective measurement, as opposed to an observer’s impression of a patient, its use may increase the accuracy of the PAWPER XL-MAC system when compared to the original system [18,19]. However, measuring MAC might take longer to produce a weight estimate, which would not be ideal during emergency care. Preliminary validation studies conducted from datasets of anthropometric data have shown the excellent accuracy of the PAWPER XL-MAC system, on par with the regular PAWPER XL tape, but no prospective studies have yet evaluated this method [19,20].
With the above background, the primary aim of this study was to evaluate the weight estimation accuracy and time to obtain weight estimation for the PAWPER XL tape and the PAWPER XL-MAC method of children from a low socioeconomic background. The secondary aim was to compare the performance of these methods with that of the Mercy method and the Broselow tape (as a past reference standard).
METHODS
Ethics statement
This study was approved by the Human Research Ethics Committee of the Faculty of Health Science of the University of the Witwatersrand (M161141). Informed consent was obtained from the parent or legal guardian, and assent was obtained from children who were above 7 years of age.
Study design
This was a prospective cross-sectional study. The study was conducted from June 2017 to September 2017.
Study site
The study took place at Baragwanath Hospital in Soweto, one of the biggest townships in South Africa, situated to the south-west of Johannesburg. Many parts of Soweto rank among the poorest in South Africa.
Study population
The study population comprised children from birth to 18 years old who presented to the pediatric unit (outpatients and inpatients), otolaryngology clinic, and ophthalmology clinic.
All children who were not in need of emergency medical treatment were eligible for inclusion into the study. The specific exclusion criteria were as follows: children whose length could not be accurately assessed (e.g., presence of contractures); failure to obtain assent from the child or consent from either guardian or parents; children who could not be weighed on a scale; and children with any known underlying conditions that would produce abnormal body composition (e.g., edema) (Fig. 1).
A non-consecutive convenience sample of 300 children was used. This sample size was sufficient to detect a 10% relative difference in accuracy between the weight estimation systems, at a power of 80%, within an accuracy range of 50% to 80%.
Weight estimation methods evaluated in this study
The Broselow tape is a length-based tape (which includes precalculated drug doses) and is one of the most studied weight estimation methods worldwide [7]. It is used by laying the tape alongside the child and aligning the start of the tape with the top of the child’s head. The weight estimation can then be read directly off the tape at the length where the heel crosses the tape. The Broselow tape can only provide weight estimations in children less than 143 cm in length.
The Mercy method is a dual length- and habitus-based method of weight estimation [21]. Measurements are taken of the child’s humeral length and MAC using a regular anthropometric tape. These measurements are used to identify ‘partial weights’ from a table (one for the humeral length and one for the MAC) which are added together to obtain the weight estimation. Recently, this method is one of the most accurate pediatric weight estimation methods in the world [2].
The PAWPER XL tape system is also a dual length- and habitusbased method of weight estimation (Fig. 2) [15]. The tape is placed alongside the child, with the start of the tape aligned to the top of the child’s head. The length segment on the tape where the child’s heel crosses the tape is then used for the weight estimation. The child’s weight estimate can be adjusted up or down from “normal weight” based on their body habitus using the HS system. Using a card with reference images for guidance, the user assigns an HS from 1 to 7 for the child. An HS of 1 would represent an underweight child, an HS of 3 a normal-weight child, an HS of 5 an obese child, and an HS of 7 a severely obese child. Each HS corresponds to a predicted weight within each length segment of the tape, which can be read off by the user. The PAWPER XL tape can provide weight estimations in children up to 180 cm in length. At present, it is also one of the most accurate weight estimation systems available globally [2,10].
The PAWPER XL-MAC method is used in the same way as the regular PAWPER XL tape, except that the HS is determined from measurements of MAC (Fig. 2) [16,19]. The tape presents MAC measurement ranges for each HS within each length segment of the tape. This allows the user to determine the appropriate HS from the child’s MAC. The corresponding predicted weights can then be read directly off the tape.
Study procedure
Fig. 1 shows the study protocol and procedures in obtaining the weight estimations. Fig. 2 provides a description of the use of the PAWPER XL tape and the PAWPER XL-MAC method. A digital electronic scale was used to obtain the participants’ actual weight (DQUIP Smart Scale, EF- 8 Series; DQUIP, Johannesburg, South Africa). Participants who were unable to stand were carried by the data collector. Then, while carrying the child, data collector stood on the electronic scale. The weight of the data collector was subtracted from the total weight to obtain the participant’s actual weight. The time to complete each measurement method was recorded for the first 10 and last 10 participants. This was done to determine the effect of training and practice on the weight estimation times.
All measurements were made by a single data collector (MTW). To minimize bias, the procedures were carried out in the same order for each child, and the data collector was blinded to the actual weight until all other estimations had been obtained. Time measurements were also performed in the exactly the same way for each weight estimation method for the subgroup of children.
Data analysis
The performances of the weight estimation methods were compared with the actual weight and against each other. Analyses of the entire study population, as well as for subgroups of weight (≤10, 10.1–20, 20.1–40, >40 kg), age (<2, 2–5, 5.1–10, >10 years), and body HS (HS <3, HS3 and HS4, HS >4) were performed.
The primary outcome measures were as follows: mean percentage error was calculated from the difference between the predicted weight and the actual weight. This gave a measurement of estimation bias; root mean squared percentage error was also calculated as a measure of precision. It is the average of the absolute (root-squared) percentage errors for each weight estimation; the number of cases that fell within 10% (PW10) and 20% (PW20) of the actual weight. This provided a measure of overall accuracy of the methods and was regarded as the primary indicator of overall performance.
Outcome measures
The primary endpoint was the performance of the PAWPER XL method and the PAWPER XL-MAC method in pediatric weight estimation and comparison with other weight prediction methods in a study sample from a public hospital in South Africa. The secondary endpoint was the time taken to perform each method and any improvement in time with increasing practice.
Statistical analysis
All data were captured from the data collection sheets and entered onto an electronic spreadsheet (Microsoft Excel for MAC 2011; Microsoft Corporation, Redmond, WA, USA). Statistical analysis was performed with Stata ver. 14 (StataCorp., College Station, TX, USA) for basic descriptive statistics and statistical comparisons.
Weight estimation data were described and analyzed using the following statistics: mean percentage difference with 95% limits of agreement—this represented the bias or trueness of the weight estimation system; the root mean squared percentage error—this represented the overall precision; and the PW10 and PW20—this represented overall accuracy.
RESULTS
A total of 300 children participated in the study. The study included 164 boys (54.7%) and 136 girls (45.3%). The median and interquartile range (IQR) for age, weight, body mass index, and body mass index-for-age z-score were 4 years (IQR, 1.3 to 8 years), 20.2 kg (IQR, 10.2 to 26.6), 15.9 kg/m2 (IQR, 13.9 to 17.3 kg/m2), and -0.8 (IQR, -1.9 to 0.4), respectively. The demographic and anthropometric parameters of the participants are summarized in Table 1.
Table 2 shows the data for all methods of weight estimation: measures of bias, precision, and accuracy for the study participants in subgroups of weight, age, and habitus category. In general, the PAWPER XL-MAC method showed the best performance statistics, followed by the PAWPER XL tape, Mercy method, and Broselow tape. Fig. 3 shows the overall accuracy of each weight estimation system (in terms of PW10 and PW20) together with the desired targets for the accuracy outcome measures, as suggested previously [2]. None of the systems achieved the desired benchmark accuracy standards in children below 2 years of age. The PAWPER XL-MAC method achieved the accuracy standards in children over 2 years of age and the Mercy method in children over 10 years of age.
Fig. 4 shows the analysis of time taken to perform the weight estimation for each method at the beginning and end of the study. Although all methods were used more quickly at the end of the study, only the PAWPER XL-MAC showed a substantial, but probably clinically unimportant, reduction in time-to-weight estimation of just over 40%.
Some participants’ weights could not be estimated using the Broselow or Mercy methods. Forty-five children (15.0%) were too tall for the Broselow tape (Table 3 shows the details of these children). One child (0.3%) was too small for both the Mercy method and the Broselow tape. All participants could have their weight estimated by the PAWPER XL tape and the PAWPER XL-MAC method.
DISCUSSION
Demographic characteristics of the study population
This study population included a large number of young children (nearly 40% were under 2 years old) and a significant number of older children (a quarter of the children were older than 8 years). The sample included children at the age at which they are most likely to present with severe acute medical illnesses (typically under 5 years old) as well as older children who are more at risk for significant trauma presentations (typically over 10 years old) [22]. It was thus reasonably representative of the type of children who might require emergency weight estimations, despite the fact that no stratified sampling strategy was used.
The body habitus categories in this study were predominantly Habitus Score 2 (HS2) (18.7%), HS3 (34.0%), and HS4 (18.7%). This was somewhat different from the initial PAWPER tape study, conducted in a population of higher economic status, where the children were assigned a body habitus of HS3 (51.4%) and HS4 (22.3%) [23]. In another South African study in a poorer community, Georgoulas et al. reported that HS were predominantly HS2 (38.0%) and HS3 (30.7%), similar to that found in the present study [13]. Despite the fact that the population has a high prevalence of underweight children, there was also a significant incidence of overweight and obese children (20.0%). This allowed for the weight estimation systems to be tested across a wide variety of ages and body habitus types.
Comparison of the performance of the weight-estimation methods
The one dimensional length-based Broselow tape (arguably the gold standard weight estimation method) had the greatest bias, lowest precision, and lowest overall accuracy, which showed its inferiority to the two dimensional (length- and habitus-based) methods. This can be attributed to the absence of body habitus considerations in the tape’s design, as has been shown in previous systematic reviews [2,8]. This edition of the Broselow tape, the 2011 edition A which is now 8 years old, was modified to limit the degree of underestimation in populations from high-income countries. Unfortunately, the accuracy has shown limited improvement in these children, but worsening accuracy in populations from low- and middle-income countries [14,24].
In our study, the Broselow tape tended to overestimate weight in both underweight and “normal weight” categories of children, but it was the most accurate in overweight children (HS >4). This was expected, as the Broselow tape has been shown to overestimate weight in a lower socioeconomic setting [6]. In a meta-analysis of the Broselow tape published in 2017, the pooled accuracy of Broselow tape was 54.7% (PW10) [7]. The lowest accuracy was in the group with low income but has a high prevalence of underweight participants, in which the PW10 was 42.2%. This was consistent with the result of this study in which the PW10 for underweight children was 43.9% [7]. The use of weight adjustment of the Broselow tape using visual estimates of body habitus or measurements such as MAC or waist circumference may be needed for the tape to remain relevant [25,26].
The PAWPER XL-MAC method was the most accurate of all the weight estimation methods. The PAWPER XL-MAC method outperformed the PAWPER XL in older and heavier children, thus suggesting that the PAWPER XL-MAC method is a more objective method than the PAWPER XL tape. Clinical gestalt may be less accurate in assessing habitus, especially in taller and heavier children: this is related to the so-called contraction bias, which is the tendency for an observer to underestimate the size of objects (or people) that are larger than average [27]. The performance of the PAWPER XL and PAWPER XL-MAC methods both improved with increasing age and body habitus. The PAWPER XL-MAC method was the least accurate in youngest children where it overestimated weight. This may be at least partly attributed to the difficulty in obtaining MAC in younger children due to poor cooperation. The width of the PAWPER XL-MAC tape is 4 cm, which limited its use to measure MAC in neonates and infants, as the tape was too broad to fit at the midpoint of the arm. In this case, a regular measuring tape had to be used. Compared to a regular measuring tape, the PAWPER XL tape is made of a sturdy material and does not conform to the natural curvature of the arm.
The performance of the PAWPER XL tape and the PAWPER XL-MAC method in previously published studies is shown in Table 4 [15,19,20,28-30]. These studies, from both high- and low-socioeconomic status populations, showed a PW10 accuracy range of 71.5% to 83.4% for the PAWPER XL tape and 79.0% to 81.9% for the PAWPER XL-MAC method, while in the present study, the PAWPER XL and PAWPER XL-MAC had an overall PW10 of 62.7% and 67.3%, respectively. In the present study, both the PAWPER XL tape and the PAWPER XL-MAC method showed higher accuracy than the Broselow tape and the Mercy method, but they did not quite achieve the accuracy rate reported in literature of nearly 80% of estimations within 10% of actual weight. This difference in accuracy may have been due to a difference in this study population and the proportion of neonates and infants analyzed. The fact that the accuracy of both these tapes was substantially higher in older children in this study (and more similar to the outcomes in other studies) suggests that the accuracy in the younger age group was a major contributor to the reduced overall accuracy. This needs to be further explored in future studies.
The discrepancy might also be caused by differences in the accuracy of habitus assessment or measurement of MAC between different users. This could possibly improve with standardized training and practice. Human factor or user errors have been shown to be important in weight estimation studies, and sufficient training and experience are essential when using any of the weight estimation systems [29,31]. The better performance of the PAWPER XL-MAC method than the PAWPER XL tape also suggested that the objectivity of the measurement of MAC for habitus assessment was superior to the subjective gestalt assessment used with the PAWPER XL tape. This was especially noticeable in underweight and obese children. These findings further support the value of the objective method of assessing habitus, with the provision that training in the use of the system is adequate [29,31].
The Mercy method showed the least bias in older and thinner children, which was consistent with a previous Australian study, but the most bias in the youngest children [17]. This was expected, as the accuracy of the Mercy method decreases in younger children [14]. Furthermore, the Mercy method was used in the supine position in some of the infants, which may also have affected its accuracy as has been suggested previously [29]. The Mercy device was originally designed for children 2 months to 16 years old, but in the present study, the Mercy method was used to estimate the weight of children from birth. The high degree of bias may, therefore, be due to the proportion of neonates included in the study (n=63). However, in the present study, the Mercy method was still more accurate than the Broselow tape.
Time taken to perform weight estimations in each method
Weight estimations using the Broselow tape and PAWPER XL tape were significantly faster than using the methods that included a measurement of MAC. Both the Broselow and the PAWPER XL tape could provide an estimated weight within 15 seconds from the time of encounter. Methods incorporating the use of MAC took >30 seconds than the non-MAC methods in this study. This is potentially important in an emergency setting where time is limited, although there is no explicit evidence to confirm this, as times taken for weight estimation have not been previously studied in any form. The PAWPER XL-MAC system showed the most improvement with practice, with an overall improvement of 22.7 seconds (a 40% reduction of the initial time). Although this was a substantial decrease in time, the significance in a clinical setting would be uncertain. This finding suggests that training and practice can improve the efficiency in the use of the PAWPER XL-MAC method and should be encouraged. In practice, the PAWPER XL tape could be used for rapid assessment of the body habitus in an urgent situation, and the PAWPER XL-MAC method could then be used to fine tune the measurement once the child was in a more stable condition [32]. Only a single previous study has reported the times taken to obtain a weight estimation [29]. The findings were very similar in terms of the times taken for weight estimation by a group of experienced emergency physicians.
Restrictions to weight estimation capability
The Broselow tape can provide weight estimation in children between 46 and 143 cm in length with a maximum weight estimation of 36 kg. In the Broselow tape method, if a child exceeds the length of the tape, adult drug dosages and equipment should be used [3]. Two studies, which examined children of appropriate age who exceeded the length of the Broselow tape, showed that the actual mean weight of this subgroup did not approximate that of adult weights [33,34]. Many children in studies using the Broselow tape, often as many as one third of the study sample, had to be excluded, as they exceeded the length of the tape [7]. Given the uncertainty of what should be done with children who exceed the length of the Broselow tape, this is a major flaw in the methodology [33]. In our study, 45 children (15%) exceeded the length of the Broselow tape, and only five children above 11 years old were able to fit within the length constraints of the tape. Although the Broselow tape is recommended for use in children up to 12 years old, even in a resource-scarce setting, the tape cannot estimate a significant proportion of the children attending the facility. All children’s weights could be estimated by the PAWPER XL and PAWPER XL-MAC methods, which was an advantage compared with the other methods in this study. It also overcomes the limitation of the original PAWPER tape in this respect.
This study has some limitations. Data collection was performed by a single researcher; therefore, no comparison of interobserver variability was possible. The clinical gestalt was based on the researcher’s perception, which may vary from that of other healthcare workers depending on experience and training. This may have limited the accuracy of weight estimation in this study below what might be theoretically possible. Further studies with more than one data collector and blinding of the investigators to the results of the weight estimation methods as well as the actual weight may assist in eliminating variability and establishing inter-observer reliability.
This study population might be different from other populations, and the results may, therefore, not be generalizable to other populations. The difference in the performance of weight estimation systems in children of different habitus and age (in particular) means that the performance metrics will differ in populations with a different demographic composition. Stratified or balanced sampling was not used to endure equal numbers of children in each age and weight category, which could potentially have introduced some bias.
In summary, the PAWPER XL-MAC method and the PAWPER XL tape were the most accurate weight estimation systems, whereas the Broselow tape had the worst performance. The PAWPER XL tape required the shortest time to generate a weight estimate, while the PAWPER XL-MAC method showed the most improvement with practice over the course of the study. The Broselow tape failed to provide weight estimation in a substantial number of children, which was a further limitation of its use. Overall, the PAWPER XL tape and the PAWPER XL-MAC method were the best performers when both accuracy and reasonable speed were considered.
Future research on the inter-observer reliability of the PAWPER XL-MAC method would be useful, as well as an assessment of the performance of this method in distinct subsets of children in different weight-status and age categories.
Notes
Professor Wells is the developer of the PAWPER tape, the PAWPER XL tape and the PAWPER XL-MAC system but derives no financial benefit from them. Except for that, no potential conflict of interest relevant to this article was reported.
References
Article information Continued
Notes
Capsule Summary
What is already known
The use of dual length- and habitus-based methods of weight estimation have been shown to be the most accurate of all systems. One such system, PAWPER XL mid-arm circumference (MAC) method showed a very high accuracy in “virtual” database studies but needed to be validated in a prospective study
What is new in the current study
The PAWPER XL-MAC method was the most accurate and outperformed the Broselow tape and the Mercy method in this study. All weight estimation systems were able to be used within a clinically appropriate time, although the methods requiring a measurement of MAC, such as the PAWPER XL-MAC and Mercy methods, took slightly longer than the other methods.