Early findings from a large-scale user study of chestnut: Validations and implications

Xiangjun Peng, Zhentao Huang, Chen Yang, Zilin Song, Xu Sun

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

44 Downloads (Pure)

Abstract

Towards a serendipitous recommender system with user-centred understanding, we have built CHESTNUT, an Information Theory-based Movie Recommender System, which introduced a more comprehensive understanding of the concept. Although off-line evaluations have already demonstrated that CHESTNUT has greatly improved serendipity performance, feedback on CHESTNUT from real-world users through online services are still unclear now. In order to evaluate how serendipitous results could be delivered by CHESTNUT, we consequently designed, organized and conducted large-scale user study, which involved 104 participants from 10 campuses in 3 countries. Our preliminary feedback has shown that, compared with mainstream collaborative filtering techniques, though CHESTNUT limited users’ feelings of unexpectedness to some extent, it showed significant improvement in their feelings about certain metrics being both beneficial and interesting, which substantially increased users’ experience of serendipity. Based on them, we have summarized three key takeaways, which would be beneficial for further designs and engineering of serendipitous recommender systems, from our perspective. All details of our large-scale user study could be found at https://github.com/unnc-idl-ucc/Early-Lessons-From-CHESTNUT.

Original languageEnglish
Title of host publicationHuman Interface and the Management of Information. Interacting with Information - Thematic Area, HIMI 2020, Held as Part of the 22nd International Conference, HCII 2020, Proceedings
EditorsSakae Yamamoto, Hirohiko Mori
PublisherSpringer
Pages65-77
Number of pages13
ISBN (Print)9783030500160
DOIs
Publication statusPublished - 2020
EventThematic Area on Human Interface and the Management of Information, HIMI 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020 - Copenhagen, Denmark
Duration: 19 Jul 202024 Jul 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12185 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceThematic Area on Human Interface and the Management of Information, HIMI 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020
Country/TerritoryDenmark
CityCopenhagen
Period19/07/2024/07/20

Keywords

  • Recommeder systems
  • Serendipity
  • User study

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Early findings from a large-scale user study of chestnut: Validations and implications'. Together they form a unique fingerprint.

Cite this