A comparison of the performance of three multiple choice question papers in obstetrics and gynaecology over a period of three years administered at five London medical schools.
Four, and later five, of the medical schools in the one multiple choice question (MCQ) paper in Obstertrics and Gynaecology to their students at the end of the Obstetrics and Gynaecology courses. The paper was amended twice after intervals of approximately 12 months. The results showed differences in performance between the five schools on questions and alternatives within questions, which were common to all editions of the paper (the "short" paper). These differences were also shown in the first two editions of the full paper (the "long" paper), but were not apparent in the third. There was a significant improvement in performance from the first to the second paper edition of the long by approximately 11%, but this was reversed from the second to the third edition, where there was a significant decrease in performance by approximately 4%. We cannot here exclude the possibility that this decrease in the third edition has resulted from sample bias. The rank order of the schools may result from differences in methods of teaching. It seems that such relative performance between London medical schools in contributed to by the differences in course legnth and by the occurence of mid-course test. It appears also that student performance in any of the schools has not been uniform over the period of the study, there being a peak during the period when the second edition of the paper was used. Variations in student selection occuring between schools may effect some of these differences. There was also a marked difference in students' performance between Obstetrics and Gynaecology. The short papers appeared easier than the full papers. Whilst this may due to the greater clarity of phrasing for the questions of the short paper, we also believe the subject matter of the short paper may be more relevant. A distinct effect could also be shown, over the period, due to improvements in the wording of the questions. It is possible that students perform better at Obstetrics than at Gynaecology.