Evaluation of user model effectiveness by simulation

Shlomo Berkovsky, Ariel Gorfinkel, Tsvi Kuflik, Larry Manevitz

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review


Accurate initialization of a User Model (UM) is important for every system that provides personalized services. However, there are systems where this initialization is critical yet no user data is available from prior interactions.
For example, systems in which both the repeat usage by a user is rare, and the
total interaction on a single use is relatively limited. Evaluating the effectiveness of a User Model and a particular instance of such a model is never an easy task, particularly through user studies. Moreover, evaluation typically focuses on the usability of an entire system rather than the performance of a specific UM instantiation. In this paper we propose evaluating the quality of UMs via simulation and comparison to a "Gold standard"; this standard is an approximation of a user's ideal model. We will demonstrate this through a case
study of a museum's visitor guide system implemented in the Hecht Museum at
the University of Haifa, Israel
Original languageEnglish
Title of host publicationProceedings of the Workshop on Personalized Access on Cultural Heritage, PATCH 2007
Subtitle of host publication11th international conference on User Modeling, UM 2007
EditorsLora Aroyo, Tsvi Kuflik, Oliviero Stock, Massimo Zancanaro
Number of pages9
Publication statusPublished - 2007
Externally publishedYes
EventPersonalized Access to Cultural Heritage workshop, PATCH 2007 - Corfu, Greece
Duration: 26 Jun 200726 Jun 2007


ConferencePersonalized Access to Cultural Heritage workshop, PATCH 2007


Dive into the research topics of 'Evaluation of user model effectiveness by simulation'. Together they form a unique fingerprint.

Cite this