Contact-Free Interaction with Computer Systems Using Computer Vision Techniques

In the area of Human-Computer Interaction (HCI), the concept of Around Device Interaction (ADI) is gaining special attention nowadays. It provides the possibility of interacting with the device by making use of gestures made in the surrounding space, as well as by detecting certain ambient changes, thus eliminating the need of direct physical contact. Contact-free interaction can be useful for wearable and smart devices, especially in cases where operating with small buttons and touchscreens appears to be particularly inconvenient. This paper presents alternative techniques for smartphone interaction based on different sensory inputs. Namely, external sources of magnetic field, light, and infrared (IR) signals are used to manipulate device sensors' readings which are in turn interpreted as the corresponding interaction commands. Proof-of-concept mobile applications are developed and here presented, demonstrating both the potentials and utility of the contact-free interaction. Specifically, small neodymium magnet was used for smartphone text entry, typical battery flashlight served for sending information to device via Morse code, as well as for alarm triggering, and voice-enabled control device was utilized for invoking smartphone calls from a distance. The presented interaction techniques do not require smartphone hardware alterations. While the usage of built-in magnetic field and ambient light sensors is assumed, peripheral infrared receiver can be used in order to provide IR-based support.

Get full-text (via PubEx)

Evolving Artificial Perception by Integrating Nlp and Cv

International Journal of Recent Technology and Engineering - 2 ◽

10.35940/ijrte.d7867.118419 ◽

2019 ◽

Vol 8 (4) ◽

pp. 3656-3659

Keyword(s):

Artificial Intelligence ◽

Computer Vision ◽

Natural Language Processing ◽

Natural Language ◽

Language Processing ◽

Computer Systems ◽

External Environment ◽

Two Dimensions ◽

The Past

This paper discusses the concept of integrating artificial perception of an artificial intelligence by integrating NLP and CV, this should be able to solve 50% of problems where the data is usually in a raw format and not understandable by the machine. This method helps in the automatic labelling and understanding the data so it is easier for the machine to understand and help in our day to day tasks. “Perception is the ability to become aware of something which is internal or in the external environment through the use of the 5 senses” this is a natural capability of humans but has never properly been achieved in a machine. In the past five years massive strides have taken place in both natural language processing and computer vision but none of these advancements have increased the intelligence and perception of computer systems in the dramatic way that was expected. This difference in what was expected and what has finally been delivered is due to the fact that both these fields have evolved separately whereas perception requires these two dimensions of hearing (Natural Language Processing) and vision (Computer Vision) to be integrated.

Get full-text (via PubEx)