Evaluating Methodologies on Deep Understanding of Mathematical Formulas in Technical Documents

Author(s):  
Nikolaos Gkorgkolis ◽  
Nikolaos Bourbakis
2021 ◽  
Vol 30 (05) ◽  
pp. 2150027
Author(s):  
Michail S. Alexiou ◽  
Nikolaos Gkorgkolis ◽  
Sukarno Mertoguno ◽  
Nikolaos G. Bourbakis

Humans are capable of understanding the knowledge that is included in technical documents automatically by consciously combining the information that is presented in the document’s individual modalities. These modalities are mathematical formulas, charts, tables, diagram images and etc. In this paper, we significantly enhance a previously presented technical document understanding methodology3 that emulates the way that humans also perceive information. More specifically, we make the original diagram understanding methodology adaptive to larger architectures with more complex structures and modules. The overall understanding methodology results in the generation of a Stochastic Petri-net (SPN) graph that describes the system’s functionality. Finally, we conclude with the introduction of the hierarchical association of different diagram images from the same technical document. This processing step aims to provide a holistic understanding of all illustrated diagram information.


2021 ◽  
Vol 30 (03) ◽  
pp. 2150016
Author(s):  
N. G. Bourbakis ◽  
G. Rematska ◽  
S. Mertoguno

Humans have the privilege to automatically have a deep understanding of technical documents, since they have the ability to deal with complex concepts coming from many different modalities, like diagrams, text, tables, formulas, graphics, pictures, etc. For many years researchers are working to transfer such potential to AI based machines. This paper takes the advantage of the synergistic and interactive enrichment of two TD modalities, the block diagrams and the associated natural language text, obtained to automatically generate pseudocode that describes the functionality of the system under study. The methodology for generating the code is mainly based on the mapping of the TD modalities into Stochastic Petri-nets (SPN) that enriches the system diagrams, from which the pseudocode is generated. The overall methodology will contribute to an automatic deep understanding of technical documents (TD) without the main involvement of humans. Two illustrative examples are also provided for describing the methodology.


2021 ◽  
Vol 30 (03) ◽  
pp. 2150015
Author(s):  
N. G. Bourbakis ◽  
G. Rematska ◽  
S. Mertoguno

The automatic deep understanding of technical documents is a privilege only to humans so far, since it requires knowledge coming from many different modalities, like text, diagrams, formulas, tables, graphics, pictures, etc. Thus, in response to this very large and complex challenge, this paper investigates the synergistic association of only two modalities, the diagrams as main modality and natural language text as an assistive one in an effort to combine them together for deeper understanding of technical documents. In particular, it presents the formal modelling of a hybrid methodology capable to automatically extract the structural and functional behavior of a system described in a technical document without the use of original code. By system here we mean the block diagram(s) of a system. The methodology presented here is based on a formal language, called Synergy, to efficiently represent and synthesize the structural features of the system, and convert them into a Stochastic Petri-nets (SPN) model as for expressing the functional behavior of the understudy system. The overall methodology will contribute to an automatic deep understanding of technical documents (TD) without the main involvement of human users.


2020 ◽  
Vol 29 (06) ◽  
pp. 2050007 ◽  
Author(s):  
Nikolaos Bourbakis ◽  
Sukarno Mertoguno

A Technical Document (TD) is mainly composed by a set of modalities appropriately structured and associated. These modalities could be NL-text, block diagrams, formulas, tables, graphics, pictures etc. A deep understanding of a TD will be based on the synergistic understanding and associations of these modalities. This paper offers a novel methodology for the implementation of a holistic approach for deep understanding of technical documents by understanding and associating these modalities. This approach is based on the homogeneous expression (mapping) of the technical document modalities into the same medium, which in this case is the Stochastic Petri-nets (SPN). Then, these modalities are associated to each other generating new knowledge about the technical document topic and a SPN simulator is created to offer additional information about the functional behavior of the system described in the document. Some results from our studies are provided to prove the overall concept.


1995 ◽  
Vol 4 (2) ◽  
pp. 62-69 ◽  
Author(s):  
Katherine Verdolini ◽  
Ingo R. Titze

In this paper, we discuss the application of mathematical formulas to guide the development of clinical interventions in voice disorders. Discussion of case examples includes fundamental frequency and intensity deviations, pitch and loudness abnormalities, laryngeal hyperand hypoadduction, and phonatory effort. The paper illustrates the interactive nature of theoretical and applied work in vocology


Author(s):  
Catherine J. Crowley ◽  
Kristin Guest ◽  
Kenay Sudler

What does it mean to have true cultural competence as an speech-language pathologist (SLP)? In some areas of practice it may be enough to develop a perspective that values the expectations and identity of our clients and see them as partners in the therapeutic process. But when clinicians are asked to distinguish a language difference from a language disorder, cultural sensitivity is not enough. Rather, in these cases, cultural competence requires knowledge and skills in gathering data about a student's cultural and linguistic background and analyzing the student's language samples from that perspective. This article describes one American Speech-Language-Hearing Association (ASHA)-accredited graduate program in speech-language pathology and its approach to putting students on the path to becoming culturally competent SLPs, including challenges faced along the way. At Teachers College, Columbia University (TC) the program infuses knowledge of bilingualism and multiculturalism throughout the curriculum and offers bilingual students the opportunity to receive New York State certification as bilingual clinicians. Graduate students must demonstrate a deep understanding of the grammar of Standard American English and other varieties of English particularly those spoken in and around New York City. Two recent graduates of this graduate program contribute their perspectives on continuing to develop cultural competence while working with diverse students in New York City public schools.


Sign in / Sign up

Export Citation Format

Share Document