TY - JOUR
T1 - Using postgraduate students' evaluations of research experience to benchmark departments and faculties
T2 - Issues and challenges
AU - Ginns, Paul
AU - Marsh, Herbert W.
AU - Behnia, Masud
AU - Cheng, Jacqueline H.S.
AU - Scalas, L. Francesca
PY - 2009/9
Y1 - 2009/9
N2 - Background: The introduction of the Australian Research Training Scheme has been a strong reason for assuring the quality of the research higher degree (RHD) experience; if students experience poor supervision, an unsupportive climate, and inadequate infrastructure, prior research suggests RHD students will be less likely to complete their degree, with negative consequences for the student, the university, and society at large. Aims: The present study examines the psychometric properties of a survey instrument, the Student Research Experience Questionnaire (SREQ), for measuring the RHD experience of currently enrolled students. The core scales of the SREQ focus on student experiences of Supervision; Infrastructure; Intellectual and Social Climate; and Generic Skills Development. Sample: Participants were 2,213 postgraduate research students of a large, research-intensive Australian university. Results: Preliminary factor analyses conducted at the student level supported the a priori four factors that the SREQ was designed to measure. However, multi-level analyses indicated that there was almost no differentiation between faculties or departments nested with faculties, suggesting that the SREQ responses are not appropriate for benchmarking faculties or departments. Conclusions: Consistent with earlier research based on comparisons across universities, the SREQ is shown to be almost completely unreliable in terms of benchmarking faculties or departments within a university.
AB - Background: The introduction of the Australian Research Training Scheme has been a strong reason for assuring the quality of the research higher degree (RHD) experience; if students experience poor supervision, an unsupportive climate, and inadequate infrastructure, prior research suggests RHD students will be less likely to complete their degree, with negative consequences for the student, the university, and society at large. Aims: The present study examines the psychometric properties of a survey instrument, the Student Research Experience Questionnaire (SREQ), for measuring the RHD experience of currently enrolled students. The core scales of the SREQ focus on student experiences of Supervision; Infrastructure; Intellectual and Social Climate; and Generic Skills Development. Sample: Participants were 2,213 postgraduate research students of a large, research-intensive Australian university. Results: Preliminary factor analyses conducted at the student level supported the a priori four factors that the SREQ was designed to measure. However, multi-level analyses indicated that there was almost no differentiation between faculties or departments nested with faculties, suggesting that the SREQ responses are not appropriate for benchmarking faculties or departments. Conclusions: Consistent with earlier research based on comparisons across universities, the SREQ is shown to be almost completely unreliable in terms of benchmarking faculties or departments within a university.
UR - http://www.scopus.com/inward/record.url?scp=68249134143&partnerID=8YFLogxK
U2 - 10.1348/978185408X394347
DO - 10.1348/978185408X394347
M3 - Article
C2 - 19583896
AN - SCOPUS:68249134143
SN - 0007-0998
VL - 79
SP - 577
EP - 598
JO - British Journal of Educational Psychology
JF - British Journal of Educational Psychology
IS - 3
ER -