usability, design, interaction design, information, web usability, user interface design, usability engineering,user testing, usability inspection, heuristic evaluation, webdesign, UI, GUI, HCI, user-centered design,human-computer interaction, mensch computer interaktion,universität konstanz, usability test, benutzerfreundlichkeit, mensch-maschine-interaktion, mensch-computer-interaktion, human-computer-interaction, usable, website usability, ergonomie, ergonomisch, psychologie, gestalt principles, scenario, information visualization,informationsvisualisierung, User Interface Evaluation, Usability testing, Human Factors, Erogonomic, Ergonomics, User Interfaces, User Interface, Interfaces, informations visualisierung, visual information seeking system, visual search interface, Mensch & Computer 2012Harald Reiterer

Research

PocketBee - a multimodal, ubiquitous tool for conducting diary studies and Experience Sampling Methods (ESM)

PocketBee - a multimodal, ubiquitous tool for conducting diary studies and Experience Sampling Methods (ESM) (Flyer)

Status

Members

Dierdorf, Gann, Ahmmed, Akram, Ali

Address

http://hci.uni-konstanz.de/pocketbee

Flyer

http://hci.uni-konstanz.de//pocketbee/PocketBee_sm_2012.pdf (Download as PDF)

Description

PocketBee - a multimodal, ubiquitous tool for conducting diary studies and Experience Sampling Methods (ESM)


This project is supported by the Customer Research Center of Daimler AG. PocketBee on Motorola Milestone

MOTIVATION

As a result of a rapidly evolving information landscape, which is more than ever being considered as ubiquitous and mobile, traditional data gathering methods from human-computer interaction and other disciplines have at times reached the limits of their usefulness. Researchers of various domains, however, are interested in investigating situations, processes, behavior, emotions, or interactions from within their natural environments. Controlled experiments with their artificial emulation of reality cannot meet this demand. Likewise, observations turn out inadequate when one wants to investigate subjective experiences of people. Moreover, they can only be seen as a snap-shot since they do not cover time. However, diary studies or Experience Sampling Methods (ESM) can be implemented when other methods cannot provide the required level of insight: for the investigation of phenomena from within their natural, spontaneous context over a larger period of time. Therefore, they contribute to other research methods as a valuable addition.


VISION

Since most traditional diary studies pose a great burden on the participant as well as a challenge on the researcher, we pursue two main goals:
  1. Leveraging multimodality, high connectivity, and sensors of contemporary smartphones to significantly alleviate the data gathering process for the participant while improving on data richness at the same time
  2. Providing an intuitive, yet powerful tool for researchers from all disciplines (i.e., non-tech savvy people) that allows creating and managing complex condition chains.

APPROACH

To help making our vision come true we will create three tools that are designed to act jointly. These are:
  1. Mobile client: The smartphone-based application allows to capture events in a convenient manner by making use of multimodality. Modalities can flexibly be combined to describe events precisely and suitably. The composed notes are transferred to a centralized server via 3G/Edge/WiFi. Once transmitted, they are immediately available to the researcher. Since PocketBee implements a two-way communication the researcher is able to modify the study on an individual basis, e.g. ask for more details about a reported event from participant C.
  2. Study designer: The PocketBee event architecture allows creating powerful condition chains. Events derived from sensors and/or via human recognition can trigger explicit and/or implicit data gathering. However, creating and maintaining overview about condition chains can be difficult, especially when complexity increases. Therefore, we develop a tool that allows a) visually creating intricate condition chains while b) reducing complexity at the same time. This is achieved by employing a zoomable user interface (ZUI) approach with semantic zooming.
  3. Study interpreter: Analyzing a large amount of mostly qualitative data (that can be related to time) poses a great challenge on any researcher. We will investigate how we can improve visualization and interaction in a collaborative setting on a tabletop.
PocketBee architecture
PocketBee client/server architecture
 
PocketBee designer
PocketBee designer
 

Publications
& Theses

Display

sorted by

in

order



2011

Longitudinal Research in Human-Computer Interaction  [main author webpage]  [Bibtex]

Gerken, Jens

PhD Thesis, Konstanz, Germany, Nov 2011

@phdthesis{Gerken20118609472,
author = {Jens Gerken},
title = {Longitudinal Research in Human-Computer Interaction},
booktitle = {PhD Thesis},
year = {2011},
type = {phdthesis},
month = {Nov},
school = {Konstanz}

}
Download PDF

Requirements Specification and Interaction-Design of a Multi-Modal Diary Application for Field-Studies  [main author webpage]  [Bibtex]

Dierdorf,Stefan

Master Thesis, University of Konstanz, Apr 2011

@mastersthesis{Dierdorf20118609485,
author = { Dierdorf,Stefan},
title = {Spezifikation von Anforderungen und Interaktionsdesign einer multi-modalen Tagebuch-Anwendung für Feld-Studien},
booktitle = {Master Thesis},
year = {2011},
type = {mastersthesis},
month = {Apr},
school = {University of Konstanz}

}
Download PDF

Improving data-gathering in field studies by using electronic devices  [main author webpage]  [Bibtex]

Schmid, Patric

Master Thesis, University of Konstanz, Mar 2011

@mastersthesis{Schmid20118609488,
author = {Patric Schmid},
title = {Improving data-gathering in field studies by using electronic devices},
booktitle = {Master Thesis},
year = {2011},
type = {mastersthesis},
month = {Mar},
school = {University of Konstanz}

}
Download PDF

2010

Pocket Bee - a multi-modal diary for field research  [main author webpage]  [Bibtex]

Gerken, Jens; Dierdorf, Stefan; Schmid, Patric; Sautner, Alexandra; Reiterer, Harald

Proc. of nordiCHI 2010: Extending Boundaries, ACM, Oct 2010

@inproceedings{Gerken20108609445,
author = {Jens Gerken and Stefan Dierdorf and Patric Schmid and Alexandra Sautner and Harald Reiterer},
title = {Pocket Bee - a multi-modal diary for field research},
booktitle = {Proc. of nordiCHI 2010: Extending Boundaries},
year = {2010},
month = {Oct},
publisher = {ACM}

}
Download PDF