EnhancedDesk

We have been developing a novel interface system to support users to perform various kinds of tasks in a regular office environment. This system is called the Enhanced Desk. The key component of the Enhanced Desk is its capability to monitor user's activities using computer vision techniques. By using an infrared camera and an image processing hardware, the system can successfully identify user's fingertips at videoframe rate even in a complicated background. In addition, the Enhanced Desk can recognize small objects on a desktop by using an additional pan-tilt camera that is tracking a user's fingertip.

	Overview of EnhancedDesk Web browsing by simply pointing barcode Users can use their fingers instead of mouse on Xwindow system Example of fingertip and palm center tracking

Research papers

• H.Koike, Y.Sato, and Y.Kobayashi: Integrating paper and digital information on EnhacedDesk: a method for real-time finger tracking on augmented desk system, ACM Trans. on Computer-Human Interaction, Vol.8, Issue.4, pp.307-322, December, 2001. PDF
  
• Hideki Koike, Yoichi Sato, Yoshinori Kobayashi, Hiroaki Tobita, Motoki Kobayashi: InterctiveTextbook and InteractiveVennDiagram: Natural and Intuitive Interface on Augmented Desk System, in Proc. of Human Factors in Computing Systems (CHI2000), pp.121-128, 2000. PDF
• Yoichi Sato, Yoshinori Kobayashi, Hideki Koike: Fast Tracking of Hands and Fingertips in Infrared Images for Augmented Desk Interface, in Proc. of IEEE Automatic Face and Gesture Recognition (FG2000), pp.462-467, 2000.