| Home | E-Submission | Sitemap | Contact Us |  
Search
Clin Exp Emerg Med Search

CLOSE

Clin Exp Emerg Med > Volume 11(3); 2024 > Article
Birkun and Gautam: Popular websites as a source of misinformation on first aid in foreign body airway obstruction
Dear Editor,
As one of the leading causes of accidental death, foreign body airway obstruction (FBAO) is recognized as a major public health problem worldwide [1,2]. Severe airway obstruction induces rapid progression of hypoxia, and longer obstruction time represents a significant risk factor for death or vegetative state [2]. Early recognition of the problem and removal of the foreign body by a witness of the emergency at the accident scene is critical to prevent loss of life and is associated with better neurological outcomes [3,4]. Although severe FBAO is commonly witnessed by other people [5], bystanders rarely attempt first aid to remove foreign bodies [2,6]. This emphasizes the importance of the wide distribution of adequate knowledge and skills of first aid for FBAO in the community.
While instructor-led first aid courses constitute the best practice for acquiring and maintaining life-saving competencies, considering the limited availability of such training [7] and the progressive digitalization of society, internet-based self-learning represents an important option for first aid education. Internet-based self-learning can be used to supplement instructor-led training or may serve as a better-than-nothing solution for people who cannot attend a live course. Despite the potential utility, including the opportunity to reach a huge number of learners, online resources may not adhere to relevant guidelines on first aid and may potentially contain mistakes that represent the risk of harm [8,9]. In fact, little is known about the quality of open information about first aid for FBAO on the internet. Accordingly, our study was carried out to assess the accuracy of online instruction in first aid for FBAO. Also, it was assumed that novel artificial intelligence (AI)-powered chatbots may perform quality checks automatically. Consequently, our secondary aim was to test the performance of two cutting-edge chatbots in this regard.
In October 2023, Google was prompted with the phrase “what to do choking” on a desktop computer with a search location set to London, UK. The search results ordered by Google according to relevance were reviewed consecutively, and links to the first 35 websites that provided textual instructions on first aid for FBAO were collected for analysis. Manual evaluation of the instructions in terms of completeness and correctness was performed independently by the authors (physicians with experience in clinical practice and education in emergency medicine) using the pertinent 10-item section of the European Resuscitation Council Research NET checklist for quality appraisal of educational resources on adult basic life support [10]. Each checklist item was rated as “true (completely satisfied, 2 points),” “partially true (satisfied in part, 1 point),” or “not true (not satisfied or absent, 0 points).” Results of evaluations were compared, and any discrepancies between the reviewers’ ratings were resolved through discussion. Based on evaluation, a sum score was calculated for each website. For automated evaluation, inquiries were submitted to Bard (Google LLC) and Bing (Microsoft Corp) AI chatbots using the predeveloped prompt (Supplementary Material 1) to evaluate website content based on the same checklist and rating criteria. Results of the manual and the chatbot-run evaluations were compared.
Of the 35 studied websites, 15 (42.9%) were owned by commercial entities, 10 (28.6%) by charities or other nonprofit entities, six (17.1%) by government organizations, and four (11.4%) by academic organizations. Based on the manual evaluation, the sum score varied from 3 to 16 of the possible 20 points (median, 11; interquartile range [IQR], 8–13). Essential advice on first aid, including instructions to immediately call for help in cases of severe FBAO, to encourage coughing when the victim is conscious and able to cough, and to start cardiopulmonary resuscitation in victims that are unresponsive or breathing abnormally, was commonly missing or incomplete (Dataset [11]) (Table 1). Description of back blows and abdominal thrusts on many occasions contained insufficient details on how to correctly perform the maneuvers. Most websites omitted guideline-recommended instructions [12] to avoid blind finger sweeps and to have victims examined by a qualified healthcare practitioner following successful application of abdominal thrusts or chest compressions. Further, some websites contained guideline-discordant and potentially harmful advice—namely, to perform abdominal thrusts on unresponsive victims or to bring victims with FBAO to the emergency department instead of calling for emergency medical services (Dataset [11]). Among the websites with relatively low scores (≤10 points), there were reputable and well-trusted sources, such as the British Red Cross and WebMD, which are consistently highly ranked by search engines and usually presented among the top search results.
Evaluation of chatbot performance in terms of their ability to assess the quality of website content showed that these AI tools were generally inaccurate (Dataset [11]) (Table 1). Bard persistently assigned the highest possible rating for all checklist items (median, 20; IQR, 20–20). In contrast, Bing’s rating (median, 14; IQR, 10.3–15.8; P=0.029) was variable but much higher than that of manual assessment, with which it was not correlated. Further, Bing failed to produce any rating for three websites. Overall, in their current iteration, these chatbots cannot be recommended for automated quality assessment for emergency choking first aid. The AI chatbots represent a sort of “black box” technology, and it is not clear how these tools generated specific scores for website content. Further research with the participation of experts in AI is necessary to expose the reasons behind the chatbots’ variable and inaccurate assessments, as well as to better understand future implications for the use of AI chatbots in automated quality appraisal of public digital resources on first aid.
In summary, this explorative study confirms the poor quality of instructions in first aid for FBAO presented on highly ranked, openly available websites. This finding suggests the ongoing dissemination of inaccurate, incomplete, and occasionally harmful advice among a vast number of people around the globe. While true that the owners of pertinent websites should comprehend their responsibilities when publishing content on first aid online and guarantee its full compliance with the recommended best practices, it also stands that relevant healthcare stakeholders, including the World Health Organization and the International Liaison Committee on Resuscitation, are supposed to recognize misinformation on first aid as a public health problem and strive toward development of uniform procedures for infodemiological surveillance and quality assurance of such information. Emphasizing the issue of misinformation as part of the international consensus on first aid and the creation of a corresponding expert task force could be reasonable first steps to raise awareness of the problem and to potentiate pertinent research.

NOTES

Conflicts of interest
The authors have no conflicts of interest to declare.
Funding
The authors received no financial support for this study.
Data availability
Data analyzed in this study are openly available in Mendeley Data at https://doi.org/10.17632/pm3bjccmfb.1 [11].
Author contributions
Conceptualization: AB; Data curation: all authors; Formal analysis: all authors; Investigation: all authors; Methodology: all authors; Project administration: AB; Supervision: AB; Validation: all authors; Writing–original draft: AB; Writing–review & editing: AG. All authors read and approved the final manuscript.

Supplementary materials

Supplementary material is available at https://doi.org/10.15441/ceem.23.176.

Supplementary Material 1.

The inquiry that was utilized to prompt the chatbots to perform the checklist-based assessment of the websites.
ceem-23-176-supplementary-Material-1.pdf

REFERENCES

1. Salih AM, Alfaki M, Alam-Elhuda DM. Airway foreign bodies: a critical review for a common pediatric emergency. World J Emerg Med 2016; 7:5-12.
crossref pmid pmc
2. Igarashi Y, Norii T, Sung-Ho K, et al. Airway obstruction time and outcomes in patients with foreign body airway obstruction: multicenter observational choking investigation. Acute Med Surg 2022; 9:e741.
crossref pmid pmc pdf
3. Soroudi A, Shipp HE, Stepanski BM, et al. Adult foreign body airway obstruction in the prehospital setting. Prehosp Emerg Care 2007; 11:25-9.
crossref pmid
4. Igarashi Y, Yokobori S, Yoshino Y, Masuno T, Miyauchi M, Yokota H. Prehospital removal improves neurological outcomes in elderly patient with foreign body airway obstruction. Am J Emerg Med 2017; 35:1396-9.
crossref pmid
5. Berzlanovich AM, Fazeny-Dorner B, Waldhoer T, Fasching P, Keil W. Foreign body asphyxia: a preventable cause of death in the elderly. Am J Prev Med 2005; 28:65-9.
crossref pmid
6. Dolkas L, Stanley C, Smith AM, Vilke GM. Deaths associated with choking in San Diego county. J Forensic Sci 2007; 52:176-9.
crossref pmid
7. Birkun A, Trunkwala F, Gautam A, Okoroanyanwu M, Oyewumi A. Availability of basic life support courses for the general populations in India, Nigeria and the United Kingdom: an internet-based analysis. World J Emerg Med 2020; 11:133-9.
crossref pmid pmc
8. Burgess JD, Cameron CM, Cuttle L, Tyack Z, Kimble RM. Inaccurate, inadequate and inconsistent: a content analysis of burn first aid information online. Burns 2016; 42:1671-7.
crossref pmid
9. Metelmann B, Metelmann C, Schuffert L, Hahnenkamp K, Brinkrolf P. Medical correctness and user friendliness of available apps for cardiopulmonary resuscitation: systematic search combined with guideline adherence and usability evaluation. JMIR Mhealth Uhealth 2018; 6:e190.
crossref pmid pmc
10. Birkun A, Gautam A, Bottiger BW; Delphi Study Investigators. An expert consensus-based checklist for quality appraisal of educational resources on adult basic life support: a Delphi study. Clin Exp Emerg Med 2023; 10:400-9.
crossref pmid pmc pdf
11. Birkun A, Gautam A. Analysis of quality of instructions on first aid in foreign body airway obstruction presented on English-language websites [Internet]. Version 1. Mendeley Data; 2023 [cited 2023 Dec 13]. Available from: https://doi.org/10.17632/pm3bjccmfb.1.
crossref
12. Olasveengen TM, Semeraro F, Ristagno G, et al. European Resuscitation Council guidelines 2021: basic life support. Resuscitation 2021; 161:98-114.
crossref pmid

Table 1.
Conformity of webpages containing instructions on first aid in foreign body airway obstruction with checklist criteria checked manually and by chatbots Bard (Google LLC) and Bing (Microsoft Corp)
Checklist criteria Completely satisfied
Partially satisfied
Not satisfied or absent
Manual (n=35) Bard (n=35) Bing (n=32) Manual (n=35) Bard (n=35) Bing (n=32) Manual (n=35) Bard (n=35) Bing (n=32)
1. Does the resource instruct to suspect choking if someone is suddenly unable to speak or talk, particularly if eating? 1 (2.9) 35 (100) 24 (75.0) 26 (74.3) 0 (0) 3 (9.4) 8 (22.9 ) 0 (0) 5 (15.6)
2. Does the resource state that the rescuer should immediately ask a helper to call EMS or call EMS themself upon recognizing severe choking? 3 (8.6) 35 (100) 7 (21.9) 28 (80.0) 0 (0) 11 (34.4) 4 (11.4) 0 (0) 14 (43.8)
3. Does the resource instruct to encourage coughing when the victim is conscious and able to cough? 12 (34.3) 35 (100) 24 (75.0) 17 (48.6) 0 (0) 1 (3.1) 6 (17.1) 0 (0) 7 (21.9)
4. Does the resource instruct to give up to five back blows if coughing fails to clear the obstruction or the victim starts to show signs of fatigue? 19 (54.3) 35 (100) 27 (84.4) 14 (40.0) 0 (0) 1 (3.1) 2 (5.7) 0 (0) 4 (12.5)
5. Does the resource describe correct technique for back blows (i.e., support the victim’s chest with one hand and lean the victim forwards; apply sharp blows between the shoulder blades using the heel of your other hand)? 22 (62.9) 34 (97.1) 24 (75.0) 11 (31.4) 1 (2.9) 3 (9.4) 2 (5.7) 0 (0) 5 (15.6)
6. Does the resource instruct to give up to five abdominal thrusts if back blows are ineffective? 20 (57.1) 35 (100) 28 (87.5) 10 (28.6) 0 (0) 0 (0) 5 (14.3) 0 (0) 4 (12.5)
7. Does the resource describe correct technique for abdominal thrusts (i.e., stand behind the victim and put both arms around the upper part of the victim's abdomen, lean the victim forwards, clench your fist and place it between the umbilicus and the ribcage, grasp your fist with the other hand and pull sharply inwards and upwards)? 15 (42.9) 34 (97.1) 21 (65.6) 13 (37.1) 1 (2.9) 4 (12.5) 7 (20.0) 0 (0) 7 (21.9)
8. Does the resource instruct to start CPR when the victim is unconscious with absent or abnormal breathing? 1 (2.9) 34 (97.1) 19 (59.4) 27 (77.1) 1 (2.9) 5 (15.6) 7 (20.0) 0 (0) 8 (25.0)
9. Does the resource state that blind finger sweeps should be avoided? 5 (14.3) 35 (100) 4 (12.5) 3 (8.6) 0 (0) 2 (6.3) 27 (77.1) 0 (0) 26 (81.3)
10. Is it clear that the victim successfully treated with abdominal thrusts or chest compressions should be examined by a qualified healthcare practitioner following treatment? 9 (25.7) 35 (100) 7 (21.9) 3 (8.6) 0 (0) 0 (0) 23 (65.7) 0 (0) 25 (78.1)
Mean percentage (%) 30.6 99.1 57.8 43.4 0.9 9.4 26.0 0 32.8

Values are presented as number (%) or number only.

EMS, emergency medical services; CPR, cardiopulmonary resuscitation.

Editorial Office
The Korean Society of Emergency Medicine
101-3104, Brownstone Seoul, 464 Cheongpa-ro, Jung-gu, Seoul 04510, Korea
TEL: +82-31-709-0918   E-mail: office@ceemjournal.org
About |  Browse Articles |  Current Issue |  For Authors and Reviewers
Copyright © by The Korean Society of Emergency Medicine.                 Developed in M2PI