Peer assessment of student-produced mechanics lab report videos

Scott S. Douglas, John M. Aiken, Shih-Yin Lin, Edwin F. Greco, Emily Alicea-Muñoz, Michael F. Schatz

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

We examine changes in students' rating behavior during a semester-long sequence of peer evaluation laboratory exercises in an introductory mechanics course. We perform a quantitative analysis of the ratings given by students to peers' physics lab reports, and conduct interviews with students. We find that peers persistently assign higher ratings to lab reports than do experts, that peers begin the semester by giving high ratings most frequently and end the semester with frequent middle ratings, and that peers go through the semester without much change in the frequency of low ratings. We then use student interviews to develop a model for student engagement with peer assessment. This model is based on two competing influences which appear to shape peer evaluation behavior: a strong disinclination to give poor ratings with a complementary preference to give high ratings when in doubt, and an attempt to develop an expertlike criticality when assessing peers' work.

Original languageEnglish
Article number020126
JournalPhysical Review Physics Education Research
Volume13
Issue number2
DOIs
Publication statusPublished - 2017 Nov 1

Fingerprint

ratings
mechanic
students
video
rating
semester
student
behavior evaluation
evaluation
physical exercise
interview
quantitative analysis
physics
expert

All Science Journal Classification (ASJC) codes

  • Education
  • Physics and Astronomy(all)

Cite this

Douglas, Scott S. ; Aiken, John M. ; Lin, Shih-Yin ; Greco, Edwin F. ; Alicea-Muñoz, Emily ; Schatz, Michael F. / Peer assessment of student-produced mechanics lab report videos. In: Physical Review Physics Education Research. 2017 ; Vol. 13, No. 2.
@article{6745e3db23264f67a5206d96552c026e,
title = "Peer assessment of student-produced mechanics lab report videos",
abstract = "We examine changes in students' rating behavior during a semester-long sequence of peer evaluation laboratory exercises in an introductory mechanics course. We perform a quantitative analysis of the ratings given by students to peers' physics lab reports, and conduct interviews with students. We find that peers persistently assign higher ratings to lab reports than do experts, that peers begin the semester by giving high ratings most frequently and end the semester with frequent middle ratings, and that peers go through the semester without much change in the frequency of low ratings. We then use student interviews to develop a model for student engagement with peer assessment. This model is based on two competing influences which appear to shape peer evaluation behavior: a strong disinclination to give poor ratings with a complementary preference to give high ratings when in doubt, and an attempt to develop an expertlike criticality when assessing peers' work.",
author = "Douglas, {Scott S.} and Aiken, {John M.} and Shih-Yin Lin and Greco, {Edwin F.} and Emily Alicea-Mu{\~n}oz and Schatz, {Michael F.}",
year = "2017",
month = "11",
day = "1",
doi = "10.1103/PhysRevPhysEducRes.13.020126",
language = "English",
volume = "13",
journal = "Physical Review Physics Education Research",
issn = "2469-9896",
publisher = "American Physical Society",
number = "2",

}

Peer assessment of student-produced mechanics lab report videos. / Douglas, Scott S.; Aiken, John M.; Lin, Shih-Yin; Greco, Edwin F.; Alicea-Muñoz, Emily; Schatz, Michael F.

In: Physical Review Physics Education Research, Vol. 13, No. 2, 020126, 01.11.2017.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Peer assessment of student-produced mechanics lab report videos

AU - Douglas, Scott S.

AU - Aiken, John M.

AU - Lin, Shih-Yin

AU - Greco, Edwin F.

AU - Alicea-Muñoz, Emily

AU - Schatz, Michael F.

PY - 2017/11/1

Y1 - 2017/11/1

N2 - We examine changes in students' rating behavior during a semester-long sequence of peer evaluation laboratory exercises in an introductory mechanics course. We perform a quantitative analysis of the ratings given by students to peers' physics lab reports, and conduct interviews with students. We find that peers persistently assign higher ratings to lab reports than do experts, that peers begin the semester by giving high ratings most frequently and end the semester with frequent middle ratings, and that peers go through the semester without much change in the frequency of low ratings. We then use student interviews to develop a model for student engagement with peer assessment. This model is based on two competing influences which appear to shape peer evaluation behavior: a strong disinclination to give poor ratings with a complementary preference to give high ratings when in doubt, and an attempt to develop an expertlike criticality when assessing peers' work.

AB - We examine changes in students' rating behavior during a semester-long sequence of peer evaluation laboratory exercises in an introductory mechanics course. We perform a quantitative analysis of the ratings given by students to peers' physics lab reports, and conduct interviews with students. We find that peers persistently assign higher ratings to lab reports than do experts, that peers begin the semester by giving high ratings most frequently and end the semester with frequent middle ratings, and that peers go through the semester without much change in the frequency of low ratings. We then use student interviews to develop a model for student engagement with peer assessment. This model is based on two competing influences which appear to shape peer evaluation behavior: a strong disinclination to give poor ratings with a complementary preference to give high ratings when in doubt, and an attempt to develop an expertlike criticality when assessing peers' work.

UR - http://www.scopus.com/inward/record.url?scp=85038558945&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85038558945&partnerID=8YFLogxK

U2 - 10.1103/PhysRevPhysEducRes.13.020126

DO - 10.1103/PhysRevPhysEducRes.13.020126

M3 - Article

AN - SCOPUS:85038558945

VL - 13

JO - Physical Review Physics Education Research

JF - Physical Review Physics Education Research

SN - 2469-9896

IS - 2

M1 - 020126

ER -