Journals › Sri Lanka Journal of Psychiatry
The validity of oral assessment (viva) that assesses specific and unique competencies in a post-graduate psychiatry examination
Sri Lanka Journal of Psychiatry 3(2): 16–19 · 2013
https://doi.org/10.4038/sljpsyc.v3i2.5133
Abstract
Background Studies have criticized oral assessments for having poor validity and reliability. There is limited research on structured oral assessments that assess specific competencies. Aims To evaluate the validity of the oral assessment component of a postgraduate psychiatry examination. Methods A retrospective analysis of the examination scores of 154 candidates from 12 postgraduate psychiatry examinations conducted during an 8 year period was carried out. Concurrent and construct validity was examined by correlating marks at the viva with the marks of theory, clinical long case and clinical short case components of the candidates. Separate multiple regression analyses were conducted to predict the scores of the different components of the examination. Results Repeated measure ANOVA showed there was no significant difference in the means between the different components of the examination (F=0.49, p=0.486). The viva was a sensitive method of assessment (79/88 =89.7%) but the specificity was low (36/66 =54.5%). Positive predictive value was 72.5% and the negative predictive value was 80.0%. Logistic regression analysis showed that the odds of passing the viva and passing the examination compared with passing the viva and failing the exam was 10.53 (95% CI 4.54- 24.47). There was a statistically significant, moderately high correlation between viva and theory components (r=.50 p
Read at the publisher Citation tracking 🔒
This index records bibliographic metadata and links to the publisher's own page. It does not host or link directly to full text. Citations recorded: 6.