Improving the validity of self-ratings of abilities: the impact of rating format and order

Ying Fong, Joanne Earl, Peter Langford

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

Previous research has found self-ratings of abilities to have low validity. Aiming to identify ways to improve self-ratings, this study investigated the impact of rating format (single-item global ratings versus multiple-item specific ratings) and order (global ratings before specific ratings versus global ratings after specific ratings) on the validity of self-rated abilities. A self-rating measure of communication skills was developed for this study for data collection from 178 medical students. The measure consisted of a global item assessing communication skills in general and eleven specific items, with each evaluating a particular dimension of communication skills. Students' self-ratings were correlated with the ratings from two groups of raters, namely communication tutors and clinical tutors, to establish validity. Results showed that students tended to provide more valid self-ratings on the specific items measuring different dimensions of communication skills than on the global item. We also found that the validity of students' self-ratings on the global item was improved when students rated themselves on the specific items prior to the global item. Theoretical and practical implications of the findings are discussed, and future research directions are suggested.
Original languageEnglish
Title of host publicationProceedings of the 43rd Annual APS Conference
Subtitle of host publicationpsychology leading change
EditorsN Voudouris, V Mrowinski
Place of PublicationMelbourne
PublisherAustralian Psychological Society
Pages159-163
Number of pages5
ISBN (Print)9780909881368
Publication statusPublished - 2008
EventAustralian Psychological Society Annual Conference (43rd : 2008) - Hobart
Duration: 23 Sept 200827 Sept 2008

Conference

ConferenceAustralian Psychological Society Annual Conference (43rd : 2008)
CityHobart
Period23/09/0827/09/08

Fingerprint

Dive into the research topics of 'Improving the validity of self-ratings of abilities: the impact of rating format and order'. Together they form a unique fingerprint.

Cite this