"Augmented Surfaces" is a computer augmented environment that allows users to smoothly interchange digital information among their portable computers, table and wall displays, and other physical objects. Supported by a camera-based object recognition system, users can easily integrate their portable computers with the pre-installed ones in the environment. Users can use displays projected on tables and walls as a spatially continuous extension of their portable computers. Using an interaction technique called hyperdragging or pick&drop (pick&beam), users can transfer information from one computer to another, by only knowing the physical relationship between them. We also provide a mechanism for attaching digital data to physical objects, such as a videotape or a document folder, to link physical and digital spaces.
Evolution of augmented direct manipulation environments: (a) A user can perform individual tasks with a portable computer. (b) The table becomes an extension of the portable computer. (c) Pre-installed computer displays (table and wall) also serve as shared workspaces for collaborative tasks.
 (a) |
 (b) |
 (c) |
Hyperdragging: A direct manipulation technique for moving information across the boundary of computers and surfaces. (a) A user can start moving an object on a computer in the normal manner by dragging it with the pointing device. (b) When the cursor reaches the edge of the screen, it ``jumps'' to the table surface. (c) The user can also drop an item on a physical object, such as a VCR tape, to make a link between real and virtual objects.
|
|
|
Capturing an image of the real object, then Hyperdragging it.
"HyperDragging" is now used in Sony VAIO-U as FlyingPointer
Pick-and-Drop by a laser pointer allows a user to smoothly transfer data between table and wall.
Digital Attachment: attaching digital data to real things.
PropCamera is used to create a 3D view of the furniture layout