HARK no more: On the preregistration of chi experiments

Andy Cockburn, Carl Gutwin, Alan Dix

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

68 Citations (Scopus)

Abstract

Experimental preregistration is required for publication in many scientific disciplines and venues. When experimental intentions are preregistered, reviewers and readers can be confident that experimental evidence in support of reported hypotheses is not the result of HARKing, which stands for Hypothesising After the Results are Known. We review the motivation and outcomes of experimental preregistration across a variety of disciplines, as well as previous work commenting on the role of evaluation in HCI research. We then discuss how experimental preregistration could be adapted to the distinctive characteristics of Human-Computer Interaction empirical research, to the betterment of the discipline.

Original languageEnglish
Title of host publicationCHI 2018 - Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
Subtitle of host publicationEngage with CHI
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450356206, 9781450356213
DOIs
Publication statusPublished - 19 Apr 2018
Externally publishedYes
Event2018 CHI Conference on Human Factors in Computing Systems, CHI 2018 - Montreal, Canada
Duration: 21 Apr 201826 Apr 2018

Publication series

NameConference on Human Factors in Computing Systems - Proceedings
Volume2018-April

Conference

Conference2018 CHI Conference on Human Factors in Computing Systems, CHI 2018
Country/TerritoryCanada
CityMontreal
Period21/04/1826/04/18

Keywords

  • Experimental preregistration
  • File drawer effect
  • Harking, p-fishing
  • Nhst controversy
  • Replication

Cite this