To demonstrate the effectiveness, usability, and educational value of a competency-oriented, one-day structured curriculum designed to improve cognitive knowledge and technical skill in flexible bronchoscopy for first year pulmonary and critical care medicine trainees.
A one day competency-oriented curriculum comprised of multiple modules, including didactic lectures, interactive sessions, and hands-on technical skill training was offered free of charge to 24 trainees and 4 faculty observers from 8 training institutions in Southern California. Pre- and post-testing of cognitive knowledge and technical skill were performed. Likert-scale evaluations of usability and educational value were administered during the course and three months later. Paired-samples t-test and non-parametric tests were used to compare pre- and post-test scores. Class-average Normalized Gain («g») was calculated using the group's mean performance.
Mean tests scores of cognitive knowledge scores improved significantly (p < 0.05) from 48% to 66% correct answers, with a total test average of 22.8 / 40 (57%). Mean improvement (Absolute Gain) was 3.5/ 20 (18%) and relative improvement (Relative Gain) 37%. Average Normalized Gain was 34%. Mean test scores of technical skill also improved significantly (p < 0.05) from 43% to 77%, with a mean improvement (Absolute Gain) of 34% and a relative improvement (Relative Gain) of 78%. Average Normalized Gain was 60%. Statistically significant improvements were noted in all five elements of technical skill (time, precision, anatomic recognition, posture/hand position, and economy of movement). Immediate and follow-up qualitative and quantitative analysis of usability and educational value uniformly revealed excellence and high levels of satisfaction, establishing the validity of this modularized educational program.
Results objectively and subjectively demonstrate the effectiveness, usability, and educational value of a competency-oriented modularized introductory course to increase cognitive knowledge and focused technical performance of novice and beginner pulmonary and critical care medicine trainees.
We have designed and validated a modularized focused course in flexible bronchoscopy. The methods demonstrated in this study can be used, in low-stakes and high-stakes testing, to measure acquisition of bronchoscopic knowledge and skills.
Mohsen Davoudi, No Financial Disclosure Information; No Product/Research Disclosure Information