Paper-digital Interaction
Taking paper-based notes is still one of the most common practices for documenting meetings. Besides note taking, customary activities in meetings include carrying out collaborative tasks. While notes are personal and remain in the users’ private information space represented by their paper notebooks, collaborative tasks take place in a shared information space accessible to all meeting participants. Recent research has pointed out affordances and benefits of interactive tabletops for collaborative activities.
Over the past seven years, an advanced set of tools and frameworks to support the development of a wide variety of applications based on interactive paper has been produced in our group. At the core of these is the iPaper framework that is capable of handling input from various types of digital pens and linking it to different types of media resources and also active content. Links to active content are based on a general concept of active components which are bound to pieces of Java program code. Since gestures often play an important role in any kind of pen- based interface, we developed the iGesture framework. iGesture supports experimentation with various gesture recognition algorithms as well as the definition of appropriate gesture sets for specific applications. Based on the existing framework for interactive paper and on the TUIO protocol for tangible multi-touch surfaces, a basic tabletop surface has also been implemented. Users’ actions on both paper documents and the tabletop can be captured with the aid of the iPaper framework.
This work will investigate ways in which interactive paper documents that support note taking activities might be used alongside an interactive tabletop in meetings. The focus will be on a particular scenario: to support collaborative tasks during meetings, personal information captured by means of interactive notebooks has to be made available to the other participants. To share information, users will transfer selected notes from their personal paper notebooks onto an interactive tabletop representing a shared information space through a form of drag-and-drop operation from one medium to the other. On the tabletop surface, further operations accessible to all the users, such as structuring and organising the information, will be offered. The drag-and- drop operation could be supported, for example, by a succession of a gesture to circle the notes to be transferred followed by a way to indicate the target device. Of particular interest in the investigations will be to identify requirements for the manipulation during the meeting and the representation in post-meeting reports of related information residing in different information spaces.
Publications:
Ispas, A., Li, N., Norrie, M. C., & Signer, B. (2010, October). Paper-digital meeting support and review. In Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom), 2010 6th International Conference on (pp. 1-10). IEEE.
Over the past seven years, an advanced set of tools and frameworks to support the development of a wide variety of applications based on interactive paper has been produced in our group. At the core of these is the iPaper framework that is capable of handling input from various types of digital pens and linking it to different types of media resources and also active content. Links to active content are based on a general concept of active components which are bound to pieces of Java program code. Since gestures often play an important role in any kind of pen- based interface, we developed the iGesture framework. iGesture supports experimentation with various gesture recognition algorithms as well as the definition of appropriate gesture sets for specific applications. Based on the existing framework for interactive paper and on the TUIO protocol for tangible multi-touch surfaces, a basic tabletop surface has also been implemented. Users’ actions on both paper documents and the tabletop can be captured with the aid of the iPaper framework.
This work will investigate ways in which interactive paper documents that support note taking activities might be used alongside an interactive tabletop in meetings. The focus will be on a particular scenario: to support collaborative tasks during meetings, personal information captured by means of interactive notebooks has to be made available to the other participants. To share information, users will transfer selected notes from their personal paper notebooks onto an interactive tabletop representing a shared information space through a form of drag-and-drop operation from one medium to the other. On the tabletop surface, further operations accessible to all the users, such as structuring and organising the information, will be offered. The drag-and- drop operation could be supported, for example, by a succession of a gesture to circle the notes to be transferred followed by a way to indicate the target device. Of particular interest in the investigations will be to identify requirements for the manipulation during the meeting and the representation in post-meeting reports of related information residing in different information spaces.
Publications:
Ispas, A., Li, N., Norrie, M. C., & Signer, B. (2010, October). Paper-digital meeting support and review. In Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom), 2010 6th International Conference on (pp. 1-10). IEEE.