Gokhman, S., Hancock, J.T., Prahbu, P., Ott, M., & Cardie., C. (2012). In search of a gold standard in studies of deception. Proceedings of the European Association of Computational Linguistics (EACL) Workshop on Deception Detection. [acceptance rate: 27%]
PDF

Abstract

In this study, we explore several popular techniques for obtaining corpora for deception research. Through a survey of traditional as well as non-gold standard creation approaches, we identify advantages and limitations of these techniques for web-based deception detection and offer crowd-sourcing as a novel avenue toward achieving a gold standard corpus. Through an in-depth case study of online hotel reviews, we demonstrate the implementation of this crowdsourcing technique and illustrate its applicability to a broad array of online reviews.