A feasible rating scale for formative and summative feedback
Savran et al., who had nine experienced gynaecologists on their team, used Delphi methodology to develop the most recent procedure-specific rating scale, which is a feasible rating scale for formative and summative feedback.23 The scale comprises 12 items evaluated on a five-point Likert scale. Messick’s framework was used to measure the validity evidence. Grouped as beginners (had performed <10 procedures) or experienced surgeons (had performed >200 procedures), 16 surgeons performed 16 laparoscopic hysterectomies. The procedure was video recorded and analysed by two blinded reviewers.
The authors found internal consistency reliability with high Cronbach’s alpha 0.95 (p<0.001) and high interrater reliability (ICC=0.996) for one rater and ICC=0.998 for two raters. The mean scores of the beginners versus the experienced surgeons were significantly different (p<0.001).
Savran et al. concluded that the tool is suitable for both formative and summative assessment.