The MuMe 2018 workshop is based on the objective to raise awareness in the user modeling community for the significance of using multiple methods in the evaluation of recommender systems and other personalized systems.

Employing a multi-method evaluation integrating a number of single methods (e.g., a combination of think-aloud and survey with open-ended questions or a combination of offline prediction simulation with an open dataset and survey with closed- and open-ended questions) allows for getting a more integrated and richer picture of user experience and quality drivers of personalized systems.

The primary goal of this workshop is to build a community around the multi-method evaluation topic and to develop a long-term research agenda for the topic.

The primary goals of the MuMe workshop are:

  • to build a community around the topic of multi-method evaluation;
  • to discuss challenges for identifying, employing, and integrating multi-method evaluation;
  • to develop a long-term research agenda to solve and/or overcome the unsolved challenges.

Important Dates:
Submission (EXTENDED): April 25, 2018
Notification: May 15, 2018
Camera ready: May 27, 2018
Workshop date: July 8, 2018
(all deadlines are AoE)