Course description:
This course introduces the basics of multimedia data formats and algorithms. Students will build applications that work with multimedia data using non-standard interfaces such as game controllers and multi-touch surfaces. Emphasis is on using open-source libraries and affordable and easily available devices.
The lab includes the conception, engineering, and utilization of novel haptic interfaces as a new media in Human-Computer Interaction (HCI). It investigates the acquisition, communication, and display of spatial, temporal, and physical knowledge of perceived reality through the human sense of touch; the integration/coordination of this knowledge with other sensory displays (such as audio, video, text, smell, etc.) in a general multimedia system. Several applications are studied including multimodal learning, gaming, and interpersonal communication.