Main findings
There is a need for robust validated tools across different measurement
properties in order to aid surgical educators in selecting the
appropriate tool for assessment. This systematic review identified eight
technical assessment tools validated during gynaecologic surgery. The
studies, which have different validity strengths according to Kane’s
framework, present a variety of challenges.
Hiemstra et al.’s16 study tested the OSATS
intraoperatively to establish learning curves for each trainee either
using direct supervision or self-assessment. As expected, learning
curves were established but the authors identified enormous variation in
assessors’ OSATS scores, and the trainees reported a lack of objectivity
in the assessment tool. This important limitation of the OSATS,
according to Kane’s validity argument, it does not meet the
extrapolation criteria.