Replication in computing education research

researcher attitudes and experiences

Alireza Ahadi, Arto Hellas, Petri Ihantola, Ari Korhonen, Andrew Petersen

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contribution

14 Citations (Scopus)


Replicability is a core principle of the scientific method. However, several scientific disciplines have suffered crises in confidence caused, in large part, by attitudes toward replication. This work reports on the value the computing education research community associates with studies that aim to replicate, reproduce or repeat earlier research. The results were obtained from a survey of 73 computing education researchers. An analysis of the responses confirms that researchers in our field hold many of the same biases as those in other fields experiencing a crisis in replication. In particular, researchers agree that original works - novel works that report new phenomena - have more impact and are more prestigious. They also agree that originality is an important criteria for accepting a paper, making such work more likely to be published. Furthermore, while the respondents agree that published work should be verifiable, they doubt this standard is widely met in the computing education field and are not eager to perform the work of verifying others' work themselves.

Original languageEnglish
Title of host publicationProceedings
Subtitle of host publication16th Koli Calling International Conference on Computing Education Research
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery
Number of pages10
ISBN (Electronic)9781450347709
Publication statusPublished - 2016
Externally publishedYes
EventKoli Calling International Conference on Computing Education Research, (16th : 2016) - Koli, Finland
Duration: 24 Nov 201627 Nov 2016


ConferenceKoli Calling International Conference on Computing Education Research, (16th : 2016)


  • research process
  • replication
  • reproduction
  • verication
  • validation
  • publication bias
  • computing education research

Fingerprint Dive into the research topics of 'Replication in computing education research: researcher attitudes and experiences'. Together they form a unique fingerprint.

Cite this