usability, design, interaction design, information, web usability, user interface design, usability engineering,user testing, usability inspection, heuristic evaluation, webdesign, UI, GUI, HCI, user-centered design,human-computer interaction, mensch computer interaktion,universität konstanz, usability test, benutzerfreundlichkeit, mensch-maschine-interaktion, mensch-computer-interaktion, human-computer-interaction, usable, website usability, ergonomie, ergonomisch, psychologie, gestalt principles, scenario, information visualization,informationsvisualisierung, User Interface Evaluation, Usability testing, Human Factors, Erogonomic, Ergonomics, User Interfaces, User Interface, Interfaces, informations visualisierung, visual information seeking system, visual search interface, Mensch & Computer 2012Harald Reiterer

Research

Cross Device Interaction

Cross Device Interaction (Flyer)

Status

Members

Johannes Zagermann, Roman Rädle, Mario Schreiner, Hans-Christian Jetter, Harald Reiterer

Address

Flyer

http://hci.uni-konstanz.de//downloads/cdi.pdf (Download as PDF)

Description


What is Cross-Device Interaction?

In recent years, the number of mobile devices has increased significantly. Along with this explosive growth, advancements in computing technology and the miniaturization makes them small, mobile, personal (super-) computers that we can carry with us. Despite their power, mobility, and density, these devices often idle away in our pockets wasting valuable computing resources.


We envision a future where mobile devices can contribute their (interaction) resources to a community of devices in their proximity. At any time, users can dynamically compose a seamless multi-device user interface (UI) and reconfigure this UI according to their current needs and the task at hand. In this vision, users also can seamlessly add or remove devices from the community without explicit setup or pairing. Instead, this happens implicitly as a byproduct of natural use in space, for example, by bringing multiple devices to the same room, placing them side-by-side on a table or desk, and moving them around as needed. Ideally, users will experience these co-located cooperating devices and reconfigurable displays as one seamless and natural user interface for ad-hoc co-located collaboration.



Activities

Cross-Surface Workshop at ISS 2016

Harald Reiterer co-organizes the third edition of the workshop "Interacting with Multi-Device Ecologies in the Wild". The focus of the third edition is Challenges and Opportunities of Spatial and Proxemic Interaction. The workshop will be held in Niagara Falls, Canada on November 6th 2016. For more information visit the workshop website.

Cross-Surface Workshop at CHI 2016

Harald Reiterer and Mario Schreiner co-organize the second edition of the workshop "Interacting with Multi-Device Ecologies in the Wild". The focus of the second edition is Challenges and Opportunities for ‘Bring Your Own Device’ in the Wild. The workshop will be held in San Jose, California from May 7 to May 12, and deals with challenges and opportunities of interaction across multiple surfaces in the wild. The second edition will further have a special focus on interactions that support Bring-Your-Own-Device Scenarios.
Read the associated blog entry

Cross-Surface Workshop at ITS 2015

Harald Reiterer co-organize the workshop "Interacting with Multi-Device Ecologies in the Wild", which is held at ITS 2015 on the island of Madeira in November 2015. The workshop deals with the challenges and opportunities of interaction across multiple surfaces in the wild.
Read the associated blog entry

Projects

Connichiwa

As a second incarnation of this vision, we present Connichiwa, a framework for creating cross device applications without the need for external sensing hardware or server infrastructure. Connichiwa abstracts away complex multi-device setup and pairing, works across different hardware platforms and architectures, and integrates full-stack web-technologies for cross device applications and communication. Beyond that, it runs a local web server on one of the participating devices, which makes external network infrastructure or an internet connection obsolete. As a framework designed to build truly self-sustaining cross-device applications, Connichiwa is compelling for many improvised activities (e.g., ad hoc meetings, outdoor scenarios, crisis management).



More details on: Connichiwa Website

Source Code: Connichiwa GitHub



HuddleLamp

As a first incarnation of this vision, we present HuddleLamp, a desk lamp with an integrated low-cost RGB-D camera that detects and identifies mobile displays (e.g., smartphones or tablets) on tables and tracks their positions and orientations with sub-centimeter precision. Users can add or remove off-the-shelf, web-enabled devices in an ad-hoc fashion without prior installation of custom hardware (e.g., radio modules, IR markers) or software. Because of HuddleLamp's web-based pairing, adding a new device is simply done by opening a URL on the device and putting it on the table so that it is visible to the camera.



HuddleLamp also tracks users' hands to enable interactions between and above devices, such as 'pick, drag, and drop.' This enables a new kind of computer-supported around-the-table collaboration. Users can sit around ordinary tables that can remain cluttered with non-digital objects (e.g., printouts, maps, notebooks) while their digital collaborations happen using spatially-aware mobile screens. They even blend into existing spatial and social practices and truly weaving themselves into the fabric of everyday life.


More details on: HuddleLamp Website

Source Code: HuddleLamp GitHub


In joint collaboration with:
University College London
University of Applied Sciences Upper Austria

Publications
& Theses

Display

sorted by

in

order



2017

Opportunities and Challenges for Cross-Device Interactions in the Wild  [main author webpage]  [Bibtex]

Houben, Steven; Marquardt, Nicolai; Vermeulen, Jo; Klokmose, Clemens; Schöning, Johannes; Reiterer, Harald; Holz, Christian

ACM Press, interactions, p. 58-63, Sep 2017

@article{Houben20178669845,
author = {Steven Houben and Nicolai Marquardt and Jo Vermeulen and Clemens Klokmose and Johannes Schöning and Harald Reiterer and Christian Holz},
title = {Opportunities and Challenges for Cross-Device Interactions in the Wild},
year = {2017},
journal = {interactions},
volume = {24},
number = {5},
pages = {58-63},
month = {Sep},
publisher = {ACM Press},
note = {http://dl.acm.org/citation.cfm?id=3121348}

}
Download PDF

Is Two Enough?! Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization  [main author webpage]  [Bibtex]

Plank, Thomas; Jetter, Hans-Christian; Rädle, Roman; Klokmose; Clemens N.; Luger, Thomas; Reiterer; Harald

In Proceedings of the 35th annual ACM conference on Human factors in computing systems (CHI ’17), ACM Press, May 2017

@inproceedings{Plank20178669748,
author = {Thomas Plank and Hans-Christian Jetter and Roman Rädle and Klokmose and Clemens N. and Thomas Luger and Reiterer and Harald},
title = {Is Two Enough?! Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization},
booktitle = {In Proceedings of the 35th annual ACM conference on Human factors in computing systems (CHI ’17)},
year = {2017},
month = {May},
publisher = {ACM Press}

}
Download PDF Video

Designing UbiComp Experiences for Spatial Navigation and Cross-Device Interactions  [main author webpage]  [Bibtex]

Rädle, Roman

PhD Thesis, Konstanz, Germany, Apr 2017

@phdthesis{Rädle20178669770,
author = {Roman Rädle},
title = {Designing UbiComp Experiences for Spatial Navigation and Cross-Device Interactions},
booktitle = {PhD Thesis},
year = {2017},
type = {phdthesis},
month = {Apr},
school = {University of Konstanz}

}
Download PDF

2016

Cross-Surface: Challenges and Opportunities of Spatial and Proxemic Interaction  [main author webpage]  [Bibtex]

Houben, Steven; Vermeulen, Jo; Klokmose, Clemens; Schöning, Johannes; Marquardt, Nicolai; Reiterer, Harald

In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS '16), ACM Press, Nov 2016

@inproceedings{Houben20168669681,
author = {Steven Houben and Jo Vermeulen and Clemens Klokmose and Johannes Schöning and Nicolai Marquardt and Harald Reiterer},
title = {Cross-Surface: Challenges and Opportunities of Spatial and Proxemic Interaction},
booktitle = {In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS '16)},
year = {2016},
month = {Nov},
publisher = {ACM Press}

}
Download PDF

Distributed Digital Desk: Studying the Effects and Influences of Ubiquitous Instrumental Interaction upon Creative Sensemaking  [Bibtex]

Acevedo, Carmela

Konstanz, Germany, Oct 2016

@mastersthesis{Acevedo20168669682,
author = {Carmela Acevedo},
title = {Distributed Digital Desk: Studying the Effects and Influences of Ubiquitous Instrumental Interaction upon Creative Sensemaking},
year = {2016},
type = {mastersthesis},
month = {Oct},
school = {University of Konstanz}

}
Download PDF

2015

Deployable Cross-Device Experiences: Proposing Additional Web Standards  [main author webpage]  [Bibtex]

Schreiner, Mario; Rädle, Roman; O'Hara, Kenton; Reiterer, Harald

Workshop Cross-Surface 2015 (in conjunction with ITS '15), University of Konstanz, Nov 2015

@inproceedings{Schreiner20158653123,
author = {Mario Schreiner and Roman Rädle and Kenton O'Hara and Harald Reiterer},
title = {Deployable Cross-Device Experiences: Proposing Additional Web Standards},
booktitle = {Workshop Cross-Surface 2015 (in conjunction with ITS '15)},
year = {2015},
month = {Nov},
publisher = {University of Konstanz}

}
Download PDF

Extending Web Technologies to Enable Ad Hoc Cross-Device Interaction  [main author webpage]  [Bibtex]

Schreiner, Mario

Master Thesis, Konstanz, Germany, Nov 2015

@mastersthesis{Schreiner20158653104,
author = {Mario Schreiner},
title = {Extending Web Technologies to Enable Ad Hoc Cross-Device Interaction},
booktitle = {Master Thesis},
year = {2015},
type = {mastersthesis},
month = {Nov},
school = {University of Konstanz}

}
Download PDF

Spatially-aware or Spatially-agnostic? Elicitation and Evaluation of User-Defined Cross-Device Interactions  [main author webpage]  [Bibtex]

Rädle, Roman; Jetter, Hans-Christian; Schreiner, Mario; Zhihao, Lu; Reiterer, Harald; Rogers, Yvonne

In Proceedings of the 33rd annual ACM conference on Human factors in computing systems (CHI '15), ACM, Apr 2015

@inproceedings{Rädle20158636443,
author = {Roman Rädle and Hans-Christian Jetter and Mario Schreiner and Lu Zhihao and Harald Reiterer and Yvonne Rogers},
title = {Spatially-aware or spatially-agnostic? Elicitation and Evaluation of User-Defined Cross-Device Interactions},
booktitle = {In Proceedings of the 33rd annual ACM conference on Human factors in computing systems (CHI '15)},
year = {2015},
month = {Apr},
publisher = {ACM}

}
Download PDF Video

Connichiwa - A Framework for Local Cross-Device Web Applications  [main author webpage]  [Bibtex]

Schreiner, Mario; Rädle, Roman; Jetter, Hans-Christian; Reiterer, Harald

In Proceedings of the 33rd annual ACM conference extended abstracts on Human factors in computing systems (CHI EA'15), ACM, Apr 2015

@inproceedings{Schreiner20158636484,
author = {Mario Schreiner and Roman Rädle and Hans-Christian Jetter and Harald Reiterer},
title = {Connichiwa - A Framework for Local Cross-Device Web Applications},
booktitle = {In Proceedings of the 33rd annual ACM conference extended abstracts on Human factors in computing systems (CHI EA'15)},
year = {2015},
month = {Apr},
publisher = {ACM}

}
Download PDF Video

2014

HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration  [main author webpage]  [Bibtex]

Rädle, Roman; Jetter, Hans-Christian; Marquardt, Nicolai; Reiterer, Harald; Rogers, Yvonne

In Proceedings of the 2014 ACM international conference on Interactive tabletops and surfaces (ITS '14), ACM, Nov 2014

@inproceedings{Rädle20148636386,
author = {Roman Rädle and Hans-Christian Jetter and Nicolai Marquardt and Harald Reiterer and Yvonne Rogers},
title = {HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration},
booktitle = {In Proceedings of the 2014 ACM international conference on Interactive tabletops and surfaces (ITS '14)},
year = {2014},
month = {Nov},
publisher = {ACM}

}
Download PDF Video

Demonstrating HuddleLamp: Spatially- Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration  [main author webpage]  [Bibtex]

Rädle, Roman; Jetter, Hans-Christian; Marquardt, Nicolai; Reiterer, Harald; Rogers, Yvonne

In Proceedings of the 2014 ACM international conference on Interactive tabletops and surfaces (ITS '14), Demo Paper, ACM, Nov 2014

@inproceedings{Rädle20148636387,
author = {Roman Rädle and Hans-Christian Jetter and Nicolai Marquardt and Harald Reiterer and Yvonne Rogers},
title = {Demonstrating HuddleLamp: Spatially- Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration},
booktitle = {In Proceedings of the 2014 ACM international conference on Interactive tabletops and surfaces (ITS '14), Demo Paper},
year = {2014},
month = {Nov},
publisher = {ACM}

}
Download PDF Video

2013

TwisterSearch: A Distributed User Interface for Collaborative Web Search  [main author webpage]  [Bibtex]

Rädle, Roman; Jetter, Hans-Christian; Reiterer, Harald

Distributed User Interfaces: Usability and Collaboration, in: Lozano, María D.; Gallud, Jose A.; Tesoriero, Ricardo; Penichet, Victor M.R., Springer London, p. 53-67, Nov 2013

@book{Rädle20138619892,
author = {Roman Rädle and Hans-Christian Jetter and Harald Reiterer},
title = {TwisterSearch: A Distributed User Interface for Collaborative Web Search},
booktitle = {Distributed User Interfaces: Usability and Collaboration},
year = {2013},
volume = {XIII},
series = {Human–Computer Interaction Series},
pages = {53-67},
month = {Nov},
publisher = {Springer London},
isbn = {978-1-4471-5498-3}

}
Download PDF

2012

TwisterSearch: Supporting Social Search with Tabletop and Mobile Displays  [main author webpage]  [Bibtex]

Rädle, Roman; Jetter, Hans-Christian; Reiterer, Harald

In Proceedings of Mensch und Computer 2012 - Interaktiv Informiert - Konstanz, Germany, inter|aktion, Demo Session, Oldenbourg, Sep 2012

@inproceedings{Rädle20128609539,
author = {Roman Rädle and Hans-Christian Jetter and Harald Reiterer},
title = {TwisterSearch: Supporting Social Search with Tabletop and Mobile Displays},
booktitle = {In Proceedings of Mensch und Computer 2012 - Interaktiv Informiert - Konstanz, Germany, inter|aktion, Demo Session},
year = {2012},
month = {Sep},
publisher = {Oldenbourg}

}
Download PDF

TwisterSearch: A distributed user interface for collaborative Web search  [main author webpage]  [Bibtex]

Rädle, Roman; Jetter, Hans-Christian; Reiterer, Harald

Proceedings of the 2nd Workshop on Distributed User Interfaces: Collaboration and Usability (In conjunction with CHI 2012 Conference), in: Tesoriero, Ricardo; Gallud, José A.; Lozano, María D.; Penichet, Víctor M. R.; Vanderdonckt, Jean, University of Castilla-La Mancha, Spain, p. 1-4, May 2012

@inproceedings{Rädle20128609527,
author = {Roman Rädle and Hans-Christian Jetter and Harald Reiterer},
title = {TwisterSearch: A distributed user interface for collaborative Web search},
booktitle = {Proceedings of the 2nd Workshop on Distributed User Interfaces: Collaboration and Usability (In conjunction with CHI 2012 Conference)},
year = {2012},
type = {inproceedings},
pages = {1-4},
month = {May},
publisher = {University of Castilla-La Mancha, Spain}

}
Download PDF Video