Magnitude of Task-Sampling Variability in Performance Assessment: A Meta-Analysis

研究成果: Article

11 引文 斯高帕斯(Scopus)

摘要

This study examined the percentage of task-sampling variability in performance assessment via a meta-analysis. In total, 50 studies containing 130 independent data sets were analyzed. Overall results indicate that the percentage of variance for (a) differential difficulty of task was roughly 12% and (b) examinee's differential performance of the same task was approximately 26%. Based on moderator analysis, research design and subject area were significant predictors of variance component for tasks (σ2 t) and variance component for person-task interaction (σ2 pt). Mathematics and listening were associated with relatively high proportion of task-sampling variability whereas foreign language was least affected by this variability. To reduce task variation, some techniques are recommended: (a) incorporating more facets when possible, (b) using a crossed rather than a nested design, and (c) incorporating occasion as a facet.

原文English
頁(從 - 到)887-912
頁數26
期刊Educational and Psychological Measurement
69
發行號6
DOIs
出版狀態Published - 2009 一月 1

All Science Journal Classification (ASJC) codes

  • Education
  • Developmental and Educational Psychology
  • Applied Psychology
  • Applied Mathematics

指紋 深入研究「Magnitude of Task-Sampling Variability in Performance Assessment: A Meta-Analysis」主題。共同形成了獨特的指紋。

  • 引用此