This paper describes a system for recognition of dynamic hand gestures. Appearance based and motion related features have been used for characterizing the gestures. Gesture sequences have been interpreted using HMM based recognition engine. Interpreted gesture sequences have been translated into commands for controlling a remote robot.