The hand gesture recognition system has an immense potential to change interface between human and machine. The interaction between human and machine through natural, ancient, and most effective way of communication is through gestures. This will enhance the capabilities of the mentally and physically enabled person through sign language as well as has N number of applications such as robot control, surveillance, and so on. This chapter illustrates the possible human-machine interaction and its types, implementation of gesture control with camera, and Kinect sensor. Gesture recognition and identification of pose in dynamic environment is done in Python language. Further use of database for hand gesture recognition and their uses are provided in the chapter for real-time implementation on the system to increase the variability use of gesture recognition.