A feasible rating scale for formative and summative
feedback
Savran et al., who had nine experienced gynaecologists on their team,
used Delphi methodology to develop the most recent procedure-specific
rating scale, which is a feasible rating scale for formative and
summative feedback.23 The scale comprises 12 items
evaluated on a five-point Likert scale. Messick’s framework was used to
measure the validity evidence. Grouped as beginners (had performed
<10 procedures) or experienced surgeons (had performed
>200 procedures), 16 surgeons performed 16 laparoscopic
hysterectomies. The procedure was video recorded and analysed by two
blinded reviewers.
The authors found internal consistency reliability with high Cronbach’s
alpha 0.95 (p<0.001) and high interrater reliability
(ICC=0.996) for one rater and ICC=0.998 for two raters. The mean scores
of the beginners versus the experienced surgeons were significantly
different (p<0.001).
Savran et al. concluded that the tool is suitable for both formative and
summative assessment.