Virtual Mouse using OpenCV

This research introduces a novel method for controlling mouse movement with a real-time camera. Adding more buttons or repositioning the mouse's tracking ball are two common ways. Instead, we recommend that the hardware be redesigned. Our idea is to employ a camera and computer vision technologies to manage mouse tasks (clicking and scrolling), and we demonstrate how it can do all that existing mouse devices can. This project demonstrates how to construct a mouse control system.

Brain-inspired spiking neural network controller for a neurorobotic whisker system

It is common for animals to use self-generated movements to actively sense the surrounding environment. For instance, rodents rhythmically move their whiskers to explore the space close to their body. The mouse whisker system has become a standard model to study active sensing and sensorimotor integration through feedback loops. In this work, we developed a bioinspired spiking neural network model of the sensorimotor peripheral whisker system, modelling trigeminal ganglion, trigeminal nuclei, facial nuclei, and central pattern generator neuronal populations. This network was embedded in a virtual mouse robot, exploiting the Neurorobotics Platform, a simulation platform offering a virtual environment to develop and test robots driven by brain-inspired controllers. Eventually, the peripheral whisker system was properly connected to an adaptive cerebellar network controller. The whole system was able to drive active whisking with learning capability, matching neural correlates of behaviour experimentally recorded in mice.

Hand Gesture Recognition System as Virtual Mouse for HCI

The technique of interaction between human and computer is evolving since the invention of computer technology. The mouse is one of the invention in HCI (human computer interaction) technology. Though wireless are Bluetooth mouse technology is invented still, that technology is not completely device free. A Bluetooth mouse has the requirement of battery power it requires extra power supply. Presence of extra devices in a mouse increases the difficulty level of more hardware components. The proposed mouse system is outside this limitation. This paper proposes a virtual mouse system using colored hand glove based on HCI using computer vision and hand gestures. Gestures captured with a webcam on processed with color segmentation, detection technique and feature extraction. The user will be allowed to control some of the computer cursor functions with a colored glove on the hand. Primarily, a user can perform with their fingers, scrolling up or down using their hands in different gestures. This system captures frames using a webcam or built-in cam it is based on the camera quality. So the usage of colored glove mouse system eliminates device dependency in order to use a mouse. Keywords: HCI(human computer interaction), colored hand glove , gestures

Operating Virtual Keyboard and Mouse Using Hand Gestures

This project promotes an approach for the Human Computer Interaction (HCI) where cursor movement can be controlled using a real-time camera, it is an alternative to the current methods including manual input of buttons or changing the positions of a physical computer mouse. Instead, it utilizes a camera and computer vision technology to control various mouse events and is capable of performing every task that the physical computer mouse can. The Virtual Mouse color recognition program will constantly acquiring real-time images where the images will undergone a series of filtration and conversion. Whenever the process is complete, the program will apply the image processing technique to obtain the coordinates of the targeted colors position from the converted frames. After that, it will proceed to compare the existing colors within the frames with a list of color combinations, where different combinations consists of different mouse functions. If the current colors combination found a match, the program will execute the mouse function, which will be translated into an actual mouse function to the users' machine.

Implementing a Real Time Virtual Mouse System and Fingertip Detection based on Artificial Intelligence

Artificial intelligence refers to the simulation of human intelligence in computers that have been trained to think and act like humans. It is a broad branch of computer science devoted to the creation of intelligent machines capable of doing activities that would normally need human intelligence. Despite the fact that Artificial intelligence is a heterogeneous science with several techniques, developments in machine learning and deep learning are driving a paradigm shift in practically every business. Human-computer interaction requires the identification of hand gestures utilizing vision-based technology. The keyboard and mouse have grown more significant in human-computer interaction in recent decades. This involves the progression of touch technology over buttons, as well as a variety of other gesture control modalities. A normal camera may be used to construct a hand tracking-based virtual mouse application. We combine camera and computer vision technologies, such as finger- tip identification and gesture recognition, into the proposed system to handle mouse operations (volume control, right click, left click), and show how it can execute all that existing mouse devices can.

Development of CNN-based Virtual Mouse

The technique of building a process of interaction between human and computer is evolving since the invention of technology. The mouse is a superb invention in HCI (Human-Computer Interaction) technology. Though wireless mouse technology is invented still, that technology isn't completely device free. A Bluetooth mouse has the need of battery power and connecting dongle. The proposed mouse system is beyond this limitation. This paper proposes a virtual mouse system supported HCI using computer vision and hand gestures. Gestures captured with a built-in camera or webcam and processed by a Convolutional Neural Network Model for classification among the desired mouse operations. The users are going to be allowed to regulate a number of the pc cursor functions with their hand gestures. Primarily, a user can perform left clicks, right clicks, and double clicks, scrolling up or down using their hand in several gestures. This technique captures frames employing a webcam or built-in cam and processes the frames to make them track-able and then recognizes different gestures made by users and perform the mouse functions. Therefore the proposed mouse system eliminates device dependency so as to use a mouse.