Speech Controllable 3D Tai Chi Tutor in Augmented Reality

Abstract

As the world’s entering its 21^st century, people are paying more and more attention to their physical and mental health against the threats brought by modernization such as over anxiety, high pressure, lack of sports, etc. On the other hand, the people suffering from cardiovascular diseases which just appeared in the recent decades nearly double its number every five years around the world. People must take actions to improve their physical and mental fitness to enjoy a healthier and longer life.

Long form Tai Chi is a 108 movement sequence designed to improve health in body and mind. Researchers have found that Tai Chi practice shows favourable effects on the promotion of balance control, flexibility, and cardiovascular fitness and reduced the risk of falls in both healthy elderly patients, and those recovering from chronic stroke, heart failure, high blood pressure, heart attacks, multiple sclerosis, Parkinson’s, and Alzheimer’s. Tai-Chi’s gentle, low impact movements can burn more calories than surfing and nearly as many as downhill skiing. There have also been indications that Tai Chi might have some effect on noradrenalin and cortical production with an effect on mood and heart rate.

The goal of the project we are talking about in this dissertation is improving both physical and mental fitness of people, especially the old group, by encouraging them to learn Tai Chi with a vivid 3D Tutor in an augmented reality game environment. The emphasis on human considerations and in particular speech as a mode of Human Computer Interaction (HCI) is also essential for a successful project implementation. Users will be able to see the 3D AR Tutor through a special pair of glasses or a video camera, and interact with him by speech.

Keywords: Tai Chi, 3D Programming, XNA, Animation Components, Speech Control, Augmented Reality, Motion Capture, Human Computer Interaction (HCI), Goblin XNA, AR Tag, Microsoft Speech SDK, 3D Max Studio, Maya, Motion Builder, Gypsy 5 Motion Capture Suit .

Pictures: