Gesture Mouse - The Core Program in Sixth Sense

                   

Gesture recognition is a language technology with the goal of interpreting human gestures via mathematical algorithms. Gestures can originate from any bodily motion or state but commonly originate from the face or hand. Current focuses in the field include emotion recognition from the face and hand gesture recognition. Many approaches have been made using cameras and computer vision algorithms to interpret sign language. However, the identification and recognition of posture, gait, proxemics, and human behaviors is also the subject of gesture recognition techniques. “GESTURE MOUSE” is an invisible computer mouse that provides the acquaintance of interface of a physical mouse without actually needing a real hardware mouse. As we improve our computer vision algorithms, an extensive library of gestures could be implemented in addition to mouse movement and mouse clicks.

         Gesture recognition can be seen as a way for computers to begin to understand human body language, thus building a richer bridge between machines and humans than primitive text user interfaces or even GUIs (graphical user interfaces), which still limit the majority of input to keyboard and mouse. The proposed gesture mouse system consists of a camera to obtain the video and frames of the hand and a CPU for processing the video. The gesture recognition algorithms are quiet complex. A number of contending software tools can be used to implement Gesture recognition. The prospective candidates are MATLAB and Scientific Python (SciPy). Python has the advantage of better interfacing with system level operation, better memory management and efficiency over MATLAB. It was identified to use SciPy with OpenCV library for implementing Gesture Mouse.

     

         Gesture  Mouse  project got  it’s origin  under  the motivation  of  Pranav Mistry’s  Sixth Sense.  So  this is a part of  the big  project done  by Pranav Mistry with  5 years  effort. User  requirement   of  this  project is world  wide.  Sixth Sense is  a  wearable gestural interface that augments the physical world  around us  with digital information  and  lets us use natural hand gestures to interact with that  information. The main purpose of our project is to replace the hardware mouse with the gesture mouse. In gesture mouse we use our hand gestures to employ the mouse functions.