The Efficacy of Medical Students to Identify Pathological Lung Sound Over a Period of Time

The Efficacy of Medical Students to Correctly Recognise Pathological From Non-pathological Lung Sounds Over a Period of Time

Title: The efficacy of medical students to correctly recognise pathological from non-pathological lung sounds over a period of time. Methodology: Randomised, controlled trial, blind study. Study Duration: The estimated duration for the main protocol (e.g., from the start of screening to the last subject processed and finishing the study) is approximately 6 months. Study Centre: Lithuanian University of Health Sciences (LSMU). Objectives: Primary Objective: To evaluate the accuracy of second-year & third-year students in correctly identifying pathological and not pathological lung sounds. Secondary Objectives: To evaluate the loss of the ability of the student to correctly identify pathological lung sounds over a period of time. Number of Subjects: 140 randomised students in two groups; the first group is the control group (CNT), and a second group (EXP) will be exposed to pathological and none pathological lung sounds. Diagnosis and Main Inclusion Criteria: Inclusion Criteria · Male and female second and third-year LSMU students, 18-40 years old, in any distribution. · Consent and compliance with all aspects of the study protocol, and methods, providing data during follow-up contact · See the methods section for the full list of inclusion criteria. Exclusion Criteria · Deafness · Age over 40 · Conditions that prevent the student from using earphones · See the methods section for a full list of exclusion criteria. Regimen: CNT group will not receive training. Whilst group will receive 3-day training for 21 patient cases (57% with pathological lung sounds). Statistical Methodology: Results will be analysed with the SPSS (version 27). A p-value < 0.05 will be considered statistically significant. The groups (CNT vs EXP) will be compared with the independent Student's t-test to see if there is a significant difference between the mean of the two groups. Though, if the data does not adhere to the parametric test's criteria a Mann-Whitney test will be applied. Whilst for the measurement made over 6 months of students' sensitivity, specificity, and accuracy (at intervals of 4, 10, 34, 184 -days) a one-way analysis of variance (ANOVA) statistical test will be applied for normally distributed data. Whilst, if data is not normally distributed a none parametric test will be applied such as Kruskal - Wallis method. McNemar's test will be applied to compare the performances of the same EXP students between their second- and third-year peers.

Purpose: The primary objective is to evaluate the accuracy, sensitivity and specificity of 2nd and 3rd-year medical students' accuracy in identifying pathological sounds after 3 days of training. Secondary Objective: To evaluate the loss of the ability of the student to correctly identify pathological lung sounds over a period of time when she/he does not undergo regular training. Background: Auscultation is one of the four pillars of patient examination [1, 2, 3], and is particularly during a pulmonary objective investigation. Today, the assessment of auscultation sounds remains largely subjective and depends on the qualifications and expertise of a specialist [4, 5]. Arts et al. [6] recommend leaving the practice of traditional auscultation to experienced specialists since sensitivity is as low as 37% when identifying between normal cases and several lung pathologies. Furthermore, auscultation skills require continuous practice and can even degrade over time [7], but can be improved through training [2]. Hence in our research were are interested to investigate the effect of training on medical students' accuracy to identify lung sounds correct. The research is created to investigate skill deterioration over a period of time. Investigator's expectations are that the research will provide us with a better understanding of how often healthcare staff should undergo training to maintain a good standard. Goals of the study: To evaluate the specificity, sensitivity and accuracy of 2nd and 3rd-year medical students whilst identifying lung sounds. To evaluate the deterioration of auscultation skills over time, to better understand how often training should be undertaken by a medical student. Duration of the Study: The study is estimated to complete enrolment within 3 days from study initiation; however, enrolment will remain open until the study goal is met. The duration of this study for each subject will be a maximum of 7 months. Product Description: Commercially available various earphones, mobile phones and PC will be used by the students. These products have been acquired by students before the research for personal use. Product Intended Use: The students' mobile phones/laptops/PCs will be used to access SAITI proprietary Website (https://saititests.github.io/). Product Acquisition: The product was acquired by students before the study with their funds and SAITI Website was developed by our research team. Methods. Study design: A double-blind study involving 140 students and 540 lung sound recordings. The lung sounds will be used for training students and then assessing their accuracy to identify pathological sounds correctly. All students studying in LSMU in the 2nd- and 3rd-years will be invited to participate in the study. Creation of a lung sound database for teaching and assessment purposes: a total of 84 patients & 504 lung sounds were recorded by an Internal Medicine physician. Permission was obtained for the study from Kaunas' Regional Bioethics committee (P1-BE-2-57/2021). All participating parties signed the bioethics agreement forms. The lung sounds were recorded in the wards of the LSMU Kaunas Hospital using a 3M Littmann model 3200 electronic stethoscope. Each of the 504 recordings was 15 seconds long. Once all lung sounds were recorded, a double-blind review was initiated. During this process, 101 lung sounds were selected by a family physician. The family physician had to listen to the lung sounds and judge if she heard crackles, wheezes, and no adventitious. The additional criterion in judging was if the lung sounds were "good enough" quality for teaching purposes or not. The cases were used for training purposes if both the Internal Medicine physician and the Family physician agreed. The students will be randomised into control (CNT) and exposed group (EXP) groups. Both of the groups will do a test after 3 days. There will be an introductory presentation for both groups about the research project. Though, only the EXP group have sections in the presentation on lung sounds. This presentation will run for about 30 - 35 min. The main topics will be to introduce the students to how the study is conducted, and what sort of pathological and none pathological sounds they can expect during the learning and assessment process. The EXP group receive access to the SAITI website with 21 questions to practice and home in their skills. Each of the 21 questions will contain one patient that was auscultated at the back at six different locations. The student will have to listen through all six channels and then she/he will be able to see the right answer. The recommendation for practice will be 90 min (per day with a 15 to 30 min break or as necessary for a student to feel comfortable. They will be allowed to spend more or less time on the SAITI website, but times will be monitored. These questions will be used to learn pathological and none pathological lung sounds. The test will have 9 questions (6 sounds associated with pathologies and 3 normal lung sounds). A follow-up test will be conducted after 1 week and 1 month, 6 months. The exam format will be kept the same during all assessments. Students will not perform training during this period on SAITI. Though students will not discourage from participating in auscultations, they will be asked to inform investigators if they did so. This will allow the assessment of pathological sound recognition skills degradation over a period of time. Data will be collected on an Excel spreadsheet system as the primary source of patient response collection. A dedicated hard-copy paper copy of the excel will be produced and kept as a backup. Results will be analysed with the SPSS (version 27) and Jamovi (version 2.3.21). A p-value < 0.05 will be considered statistically significant. The groups (CNT vs EXP) will be compared with the independent Student's t-test to see if there is a significant difference between the mean of the two groups. Though, if the data does not adhere to the parametric test's criteria a Mann-Whitney test will be applied. Whilst for the measurement made over 6 months of students' sensitivity, specificity, and accuracy (at intervals of 4, 10, 34, 184 -days) a one-way analysis of variance (ANOVA) statistical test will be applied for normally distributed data. Whilst, if data is not normally distributed a none parametric test will be applied such as Kruskal - Wallis method. McNemar's test will be applied to compare the performances of the same EXP students between their second- and third-year peers. Study population and selection criteria. All aspects of the study and consent forms will be the Lithuanian city of Kaunas regional bioethics committee approved before implementation. All participants will require full informed consent, be willing and able to comply with all study requirements and will meet the following criteria; male or female aged 18-40 (inclusive), must be LSMU students studying in 2nd and 3rd year. Subjects will be excluded from the study based on the following criteria: Not a student at LSMU; Not studying in 2nd- and 3rd-year of medicine; Age over 40-year-old; Deaf; The subject does not provide full consent; Recruitment methods; Subjects will be identified and contacted through the Student Scientific Society, and further contacted via emails. Data collection and reporting. Data will be collected at the following points: immediately after 3 days of training, after 1st -4th day, 2nd - 10 days after training, 3rd - 34 days after training and 4th - 184 days after training assessment. The assessment will have 15 questions (9 sounds associated with pathologies and 6 normal lung sounds). Data from the study will be maintained for two (2) years after the date the investigation is completed, terminated or until the records are no longer required to support the protocol, whichever date is later. Expected outcomes. The study has the potential to improve students' auscultation skills. By showing how often the students are trained to maintain a high level of accuracy, specificity and sensitivity in identifying pathological from none pathological lung sounds. Adverse reactions: The is no expectation of any adverse outcomes or reactions. Reasons for withdrawal or termination: A subject may be discontinued from the study at any time if the subject or Investigator feels that it is not in the subject's best interest to continue. The following is a list of possible reasons for study treatment discontinuation: Subject withdrawal of consent; The subject is not compliant with study procedures; Protocol violation requiring discontinuation; All subjects are free to withdraw from participation at any time, for any reason, specified or unspecified, and without prejudice. Reasonable attempts will be made by the Investigator to provide a reason for subject withdrawals. The reason for the subject's withdrawal from the study will be specified in the subject's source documents and the Case Report Form (CRF). Methods and Study Schedule: Subjects eligible for the study will review and undergo informed consent. Once consented, subjects will be randomly assigned on a 1:1 basis into two groups: EXP Group- where subjects will be trained for 3 days to identify pathological lung sounds before assessment/assessments. CNT group will not receive a 3-day training. EXP and CNT groups will additionally have a 25 - 35 min introduction session. Where students will be given an introduction to the project, auscultation sounds examples and their descriptions will be provided. Any additional questions about the project will be answered that might affect students' ability to do it. Contact initiation with the subject (Day 0): The student will be contacted with an offer to participate in the study. In terms of subjects accepting to participate in the study and fulfilling inclusion/exclusion criteria, they will be randomized into two groups: Control Group (CNT): 70 Students, Exposed group (EXP): 70 students. Follow-Up Assessment: After an initial assessment, an examination will be performed at the following time points: 10 days, 34 days, and 184 days. SAMPLE SIZE JUSTIFICATION Sample Size Calculations: The following type I error rates and decision boundaries for the study are specified: Primary outcomes are accuracy, specificity, and sensitivity measurements of the subjects. Null hypothesis: There is no difference in accuracy, specificity, or sensitivity of CNT and EXP groups. Type I error rate: α=0.05. Power calculations based on the pilot study's data for accuracy The following formula was used to calculate the minimum sample size required for the actual study to find a difference in accuracy between CNT and EXP groups. n=(S1^2+S2^2 )×(Zq1^2+Zq2^2 )^2/∆^2 where: S1^2 and S1^2 are variances of pilot samples ∆ is the smallest clinically important difference of means chosen by the researcher. Zq1 and Zq2 are quantiles of the standard normal distribution Hence, in our study variance was 0.8258-0.7250= 0.1008 between the groups. The delta is taken at 0.05. Whilst normal distribution quantities are Zq1= 1.96 for the two-sided alternative and Zq2=20.8416 when f α=0.05 and β=0.2. The calculations give us an answer of n≈32. During the pilot investigation, of 31 students that were invited 17 finished the study. That is ~54 %. Therefore, an assumption is made for the SAITI-T study, that attrition rates will be around 50 %. Therefore, the study needs 64 to 70 students in the enrolment stage for each group (140 in total). Randomization: Subjects who meet all inclusion and exclusion criteria will be randomised into two groups. The subjects will be split into 1:1 ratio to either the exposed group (EXP) or the control group CNT. ASSESSMENT OF SAFETY. Purpose: The primary objective is to evaluate the accuracy, sensitivity and specificity of 2nd- and 3rd-year medical students' accuracy in identifying pathological sounds after 3 days of training.

Auscultation, Lung sounds, Pathological lung sounds, Adventitious lung sounds, Simulation-based learning, Clinical skill decline

The 140 students will be randomised into CNT and EXP groups. Both of the groups will do a test after 3 days. There will be an introductory presentation (30-35 min) for both groups. The EXP group receive access to the SAITI website with 16 questions to practice and home in their skills. The recommendation for practice will be 45- 90 min per day. Students' diagnostic accuracy will be assessed on the 4th day via 9 questions. Tests will be repeated at intervals of 10, 34, and 184 days. The exam format will be kept the same during all assessments with no additional training. Though students will not discourage from participating in auscultations, they will be asked to inform investigators if they did so. This will allow the assessment of pathological sound recognition skills degradation over a period of time. Data will be collected on a spreadsheet, analysed via JASP and SPSS.

Control Group (CNT): 70 Students. The CNT group will only receive an introductory lecture about the SAITI-T study and how to use the website. The CNT subjects will not receive training on lung sounds.

Exposed group (EXP): 70 students. EXP group - subjects will be trained for 3 days to identify pathological lung sounds before assessment/assessments. The EXP subjects additionally have an introductory lecture about the SAITI-T study and how to use the website.

First group is the control group (CNT), second group (EXP) who will be exposed to pathological and none pathological lung sounds

Students' Accuracy, Specificity, Sensitivity in Identifying Pathological Lung Sounds After 3-days Training

Key measures of medical students' specificity, sensitivity and accuracy to identify pathological lung sounds will be assessed over a period of 4 days from the initiation of training.

Potential Degradation of Students' Accuracy, Specificity, and Sensitivity in Identifying Pathological Lung Sounds After 10 Days

Key measures of medical students' specificity, sensitivity and accuracy to identify pathological lung sounds will be assessed 10 days from the initiation of training. During a period of 7 days, students do not receive any additional training. The specificity, sensitivity and accuracy of the subjects are compared to "Outcome 1" results.

Potential Degradation of Students' Accuracy, Specificity, and Sensitivity in Identifying Pathological Lung Sounds After 34 Days

Key measures of medical students' specificity, sensitivity and accuracy to identify pathological lung sounds will be assessed 34 days from the initiation of training. During a period of 31 days, students do not receive any additional training. The specificity, sensitivity and accuracy of the subjects are compared to "Outcome 1" results.

Potential Degradation of Students' Accuracy, Specificity, and Sensitivity in Identifying Pathological Lung Sounds After 184 Days

Key measures of medical students' specificity, sensitivity and accuracy to identify pathological lung sounds will be assessed 184 days after training. During a period of 181 days, students do not receive any additional training. The specificity, sensitivity and accuracy of the subjects are compared to "Outcome 1", "Outcome 2" and "Outcome 3" results.

Inclusion Criteria: Male and female second and third-year LSMU students; 18 years and older; subject that provides full written consent to participate in the study. Exclusion Criteria: not a second-year or third-year at LSMU; deafness; age over 40; conditions that prevent students from using earphones; subject does not provide full consent.

Narula J, Chandrashekhar Y, Braunwald E. Time to Add a Fifth Pillar to Bedside Physical Examination: Inspection, Palpation, Percussion, Auscultation, and Insonation. JAMA Cardiol. 2018 Apr 1;3(4):346-350. doi: 10.1001/jamacardio.2018.0001.

D. Pereira, P. Gomes, C. Sa Couto, O. Costa, Z. Reis, S. Mattos, R. Cruz-Correia, and M. Coimbra. IS4Learning-A Multiplatform Simulation Technology to Teach and Evaluate Auscultation Skills. In Health Professionals' Education in the Age of Clinical Information Systems Mobile Computing and Social Networks, pages 401-420. Elsevier, 2017. doi:10.1016/b978-0-12-805362-1.00019-x.

Garvick S, Gillette C, Gao H, Bates N, Waynick J, Crandall S. Can cardiac auscultation accuracy be improved with an additional app-based learning tool? Clin Teach. 2022 Apr;19(2):112-120. doi: 10.1111/tct.13462. Epub 2022 Feb 8.

Hafke-Dys H, Breborowicz A, Kleka P, Kocinski J, Biniakowski A. The accuracy of lung auscultation in the practice of physicians and medical students. PLoS One. 2019 Aug 12;14(8):e0220606. doi: 10.1371/journal.pone.0220606. eCollection 2019.

Kim Y, Hyon Y, Jung SS, Lee S, Yoo G, Chung C, Ha T. Respiratory sound classification for crackles, wheezes, and rhonchi in the clinical field using deep learning. Sci Rep. 2021 Aug 25;11(1):17186. doi: 10.1038/s41598-021-96724-7.

Arts L, Lim EHT, van de Ven PM, Heunks L, Tuinman PR. The diagnostic accuracy of lung auscultation in adult patients with acute pulmonary pathologies: a meta-analysis. Sci Rep. 2020 Apr 30;10(1):7347. doi: 10.1038/s41598-020-64405-6.

Darbyshire JL, Young JD. An investigation of sound levels on intensive care units with reference to the WHO guidelines. Crit Care. 2013 Sep 3;17(5):R187. doi: 10.1186/cc12870.

Buderer NM. Statistical methodology: I. Incorporating the prevalence of disease into the sample size calculation for sensitivity and specificity. Acad Emerg Med. 1996 Sep;3(9):895-900. doi: 10.1111/j.1553-2712.1996.tb03538.x.

Šimoliūnienė R, Tomkevičiūtė J, Jokšienė Ž, Šimatonienė V, Kriščiukaitis A, Šaferis V. Basics of biostatistics : [teaching book]. Kaunas : Lithuanian University of Health Sciences publication house. 2016.