usability, design, interaction design, information, web usability, user interface design, usability engineering,user testing, usability inspection, heuristic evaluation, webdesign, UI, GUI, HCI, user-centered design,human-computer interaction, mensch computer interaktion,universität konstanz, usability test, benutzerfreundlichkeit, mensch-maschine-interaktion, mensch-computer-interaktion, human-computer-interaction, usable, website usability, ergonomie, ergonomisch, psychologie, gestalt principles, scenario, information visualization,informationsvisualisierung, User Interface Evaluation, Usability testing, Human Factors, Erogonomic, Ergonomics, User Interfaces, User Interface, Interfaces, informations visualisierung, visual information seeking system, visual search interface, Mensch & Computer 2012Harald Reiterer


PocketBee - a multimodal, ubiquitous tool for conducting diary studies and Experience Sampling Methods (ESM)

PocketBee - a multimodal, ubiquitous tool for conducting diary studies and Experience Sampling Methods (ESM) (Flyer)



Dierdorf, Gann, Ahmmed, Akram, Ali


Flyer (Download as PDF)


PocketBee - a multimodal, ubiquitous tool for conducting diary studies and Experience Sampling Methods (ESM)

This project is supported by the Customer Research Center of Daimler AG. PocketBee on Motorola Milestone


As a result of a rapidly evolving information landscape, which is more than ever being considered as ubiquitous and mobile, traditional data gathering methods from human-computer interaction and other disciplines have at times reached the limits of their usefulness. Researchers of various domains, however, are interested in investigating situations, processes, behavior, emotions, or interactions from within their natural environments. Controlled experiments with their artificial emulation of reality cannot meet this demand. Likewise, observations turn out inadequate when one wants to investigate subjective experiences of people. Moreover, they can only be seen as a snap-shot since they do not cover time. However, diary studies or Experience Sampling Methods (ESM) can be implemented when other methods cannot provide the required level of insight: for the investigation of phenomena from within their natural, spontaneous context over a larger period of time. Therefore, they contribute to other research methods as a valuable addition.


Since most traditional diary studies pose a great burden on the participant as well as a challenge on the researcher, we pursue two main goals:
  1. Leveraging multimodality, high connectivity, and sensors of contemporary smartphones to significantly alleviate the data gathering process for the participant while improving on data richness at the same time
  2. Providing an intuitive, yet powerful tool for researchers from all disciplines (i.e., non-tech savvy people) that allows creating and managing complex condition chains.


To help making our vision come true we will create three tools that are designed to act jointly. These are:
  1. Mobile client: The smartphone-based application allows to capture events in a convenient manner by making use of multimodality. Modalities can flexibly be combined to describe events precisely and suitably. The composed notes are transferred to a centralized server via 3G/Edge/WiFi. Once transmitted, they are immediately available to the researcher. Since PocketBee implements a two-way communication the researcher is able to modify the study on an individual basis, e.g. ask for more details about a reported event from participant C.
  2. Study designer: The PocketBee event architecture allows creating powerful condition chains. Events derived from sensors and/or via human recognition can trigger explicit and/or implicit data gathering. However, creating and maintaining overview about condition chains can be difficult, especially when complexity increases. Therefore, we develop a tool that allows a) visually creating intricate condition chains while b) reducing complexity at the same time. This is achieved by employing a zoomable user interface (ZUI) approach with semantic zooming.
  3. Study interpreter: Analyzing a large amount of mostly qualitative data (that can be related to time) poses a great challenge on any researcher. We will investigate how we can improve visualization and interaction in a collaborative setting on a tabletop.
PocketBee architecture
PocketBee client/server architecture
PocketBee designer
PocketBee designer

& Theses


sorted by




Longitudinal Research in Human-Computer Interaction  [main author webpage]  [Bibtex]

Gerken, Jens

PhD Thesis, Konstanz, Germany, Nov 2011

author = {Jens Gerken},
title = {Longitudinal Research in Human-Computer Interaction},
booktitle = {PhD Thesis},
year = {2011},
type = {phdthesis},
month = {Nov},
school = {Konstanz}

Download PDF

Requirements Specification and Interaction-Design of a Multi-Modal Diary Application for Field-Studies  [main author webpage]  [Bibtex]


Master Thesis, University of Konstanz, Apr 2011

author = { Dierdorf,Stefan},
title = {Spezifikation von Anforderungen und Interaktionsdesign einer multi-modalen Tagebuch-Anwendung für Feld-Studien},
booktitle = {Master Thesis},
year = {2011},
type = {mastersthesis},
month = {Apr},
school = {University of Konstanz}

Download PDF

Improving data-gathering in field studies by using electronic devices  [main author webpage]  [Bibtex]

Schmid, Patric

Master Thesis, University of Konstanz, Mar 2011

author = {Patric Schmid},
title = {Improving data-gathering in field studies by using electronic devices},
booktitle = {Master Thesis},
year = {2011},
type = {mastersthesis},
month = {Mar},
school = {University of Konstanz}

Download PDF


Pocket Bee - a multi-modal diary for field research  [main author webpage]  [Bibtex]

Gerken, Jens; Dierdorf, Stefan; Schmid, Patric; Sautner, Alexandra; Reiterer, Harald

Proc. of nordiCHI 2010: Extending Boundaries, ACM, Oct 2010

author = {Jens Gerken and Stefan Dierdorf and Patric Schmid and Alexandra Sautner and Harald Reiterer},
title = {Pocket Bee - a multi-modal diary for field research},
booktitle = {Proc. of nordiCHI 2010: Extending Boundaries},
year = {2010},
month = {Oct},
publisher = {ACM}

Download PDF