Nerva: Automated application synthesis for humanoid robot from user natural language description

2017 ◽  
Vol 17 (1) ◽  
pp. 45-64
Author(s):  
Hao Li ◽  
Yu-Ping Wang ◽  
Tai-Jiang Mu
2021 ◽  
Vol 12 (1) ◽  
pp. 87-110
Author(s):  
Wladimir Stalski

Abstract On the basis of the author’s earlier works, the article proposes a new approach to creating an artificial intellect system in a model of a human being that is presented as the unification of an intellectual agent and a humanoid robot (ARb). In accordance with the proposed new approach, the development of an artificial intellect is achieved by teaching a natural language to an ARb, and by its utilization for communication with ARbs and humans, as well as for reflections. A method is proposed for the implementation of the approach. Within the framework of that method, a human model is “brought up” like a child, in a collective of automatons and children, whereupon an ARb must master a natural language and reflection, and possess self-awareness. Agent robots (ARbs) propagate and their population evolves; that is ARbs develop cognitively from generation to generation. ARbs must perform the tasks they were given, such as computing, whereupon they are then assigned time for “private life” for improving their education as well as for searching for partners for propagation. After having received an education, every agent robot may be viewed as a “person” who is capable of activities that contain elements of creativity. The development of ARbs thanks to the evolution of their population, education, and personal “life” experience, including “work” experience, which is mastered in a collective of humans and automatons.


Author(s):  
Md. Asifuzzaman Jishan ◽  
Khan Raqib Mahmud ◽  
Abul Kalam Al Azad

We presented a learning model that generated natural language description of images. The model utilized the connections between natural language and visual data by produced text line based contents from a given image. Our Hybrid Recurrent Neural Network model is based on the intricacies of Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and Bi-directional Recurrent Neural Network (BRNN) models. We conducted experiments on three benchmark datasets, e.g., Flickr8K, Flickr30K, and MS COCO. Our hybrid model utilized LSTM model to encode text line or sentences independent of the object location and BRNN for word representation, this reduced the computational complexities without compromising the accuracy of the descriptor. The model produced better accuracy in retrieving natural language based description on the dataset.


The research deals with the original algorithms of the linguistic processor integration for solving planimetric problems. The linguistic processor translates the natural language description of the problem into a semantic representation based on the ontology that supports the axiomatics of geometry. The linguistic processor synthesizes natural-language comments to the solution and drawing objects. The method of interactive visualization of the linguistic processor functioning is proposed. The method provides a step-by-step dialog control of syntactic structure construction and its display in semantic representation. During the experiments, several dozens of standard syntactic structures correctly displayed in the semantic structures of the subject area were obtained. The direction of further research related to the development of the proposed approach is outlined.


Sign in / Sign up

Export Citation Format

Share Document