|
Ph.D. Candidate |
|
|
Hand-held computing devices are ubiquitous and have become part of our lives these days. Moreover, hand-held devices are also increasingly being equipped with special sensors and non-traditional displays. As such, it raises the question of whether such a small and reduced device could serve as an effective virtual reality (VR) platform and provide sufficient immersion and presence, e.g. through multimodal interaction. In this research, we address this question by adding multimodal functionalities such as motion based interaction, user-display dependent rendering, autostereoscopic small display, vibrotactile feedback and etc. Also we show the feasibility of hand-held virtual reality by comparing with other VR systems. Selected Papers:
|
|
|
In a collaborative system, the level of co-presence, the feeling of being with the remote participants in the same working environment, is very important for natural and efficient task performance. One way to achieve such copresence is to recreate the participants as real as possible, for instance, with the 3D whole body representation. In this research, we introduce a method to recreate and immerse tele-operators in a collaborative augmented reality (AR) environment. The method starts with capturing the 3D cloud points of the remote operators and reconstructs them in the shared environment in real time. In order to realize interaction among the participants, the operator's motion is tracked using a feature extraction and point matching (PM) algorithm. With the participant tracking, various types of 3D interaction becomes possible. Selected Papers:
|
|
|
The advantages that using VR techniques for rehabilitation are easy of development, easy of modification, safeties and etc. In this research, especially we proposed the system for 3D motion rehabilitation with multimodal sensory effects such as vibro-tactile feedback, motion based interaction and etc. Selected Papers:
|
|
|
Recent progress in digital music has enabled some form of active music appreciation. In particular, with the advent of affordable VR technologies, many researchers are experimenting with the three-dimensional and multimodal interfaces to control music and replace the current keyboard/mouse-based (piano or computer) interface for computer/electronic music. Given such a background, we proposes and demonstrates the concept of the Virtual Music Environment (VME), a generalization of a virtual music instrument, in which the virtual world itself acts as a source of multimodal (e.g. visual, audio, haptic) feedback, and at the same time, a place of interaction. more Selected Papers:
|