Unfolding the phenomenon of interrater agreement: a multicomponent approach for in-depth examination was proposed.
OBJECTIVE: The overall objective was to unfold the phenomenon of interrater agreement: to identify potential sources of variation in agreement data and to explore how they can be statistically accounted for. The ultimate aim was to propose recommendations for in-depth examination of agreement to improve the reliability of assessment instruments. STUDY DESIGN AND SETTING: Using a sample where 1