scholarly journals Automated Generation of Executable RPA Scripts from User Interface Logs

2020 ◽  
pp. 116-131
Author(s):  
Simone Agostinelli ◽  
Marco Lupia ◽  
Andrea Marrella ◽  
Massimo Mecella
Keyword(s):  
User Interface ◽  
Automated Generation

scholarly journals Leveraging Graphical User Interface Automation for Generic Robot Programming

Robotics ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. 3
Author(s):  
Tudor B. Ionescu
Keyword(s):  
User Interface ◽  
Graphical User Interface ◽  
Programming Models ◽  
Shop Floor ◽  
Robot Programming ◽  
User Interactions ◽  
Programming Environments ◽  
Automated Generation ◽  
Novel Approach ◽  
Block Based

A novel approach to generic (or generalized) robot programming and a novel simplified, block-based programming environment, called “Assembly”, are introduced. The approach leverages the newest graphical user interface automation tools and techniques to generate programs in various proprietary robot programming environments by emulating user interactions in those environments. The “Assembly” tool is used to generate robot-independent intermediary program models, which are translated into robot-specific programs using a graphical user interface automation toolchain. The generalizability of the approach to list, tree, and block-based programming is assessed using three different robot programming environments, two of which are proprietary. The results of this evaluation suggest that the proposed approach is feasible for an entire range of programming models and thus enables the generation of programs in various proprietary robot programming environments. In educational settings, the automated generation of programs fosters learning different robot programming models by example. For experts, the proposed approach provides a means for generating program (or task) templates, which can be adjusted to the needs of the application at hand on the shop floor.

A Method for Generating Multiplatform User Interfaces for E-Learning Environments

2010 ◽  
pp. 90-111
Author(s):  
Juan Manuel González Calleros ◽  
Josefina Guerrero García ◽  
Jaime Muñoz Arteaga ◽  
Jean Vanderdonckt ◽  
Francisco Javier Martínez Ruiz
Keyword(s):  
User Interface ◽  
Learning Environments ◽  
User Interfaces ◽  
Learning Process ◽  
Automated Generation ◽  
Task Model ◽  
Extensible Markup ◽  
E Learning ◽  
Computing Platforms ◽  
Definition Of

In this paper the authors present a structured method for automatically generating User Interfaces for e-learning environments. The method starts with a definition of the learning scenario where the different goals, jobs (professor-student/trainer-learner), and tasks are described and stored in a template. After, the description is mapped to FlowiXML, a learning process authoring tool, where graphically trainers or content designers draw the overall process. A learning process is viewed as a workflow and modeled using Petri net notation. From each step in the process model more details are added using user task models; user’s activity interacting with a user interface is stored in such diagrams. Then, a transformational method for developing user interfaces of interactive information systems is used that starts from a task model and a domain model to progressively derive a final user interface. This method consists of three steps: deriving one or many abstract user interfaces from the task model, deriving one or many concrete user interfaces from each abstract interface, and producing the code of the final user interfaces corresponding to each concrete interface. The models and the transformations of these models are all expressed in UsiXML (User Interface eXtensible Markup Language) and maintained in a model repository that can be accessed by the suite of tools. Developing user interfaces in this way facilitates its automated generation over multiple computing platforms while maintaining portability and consistency between the multiple versions. Our approach is illustrated on an open Learning environment using a case study.

Remote On-Line Control of a High-Voltage in situ Transmission Electron Microscope with A Rational User Interface

1996 ◽  
Vol 54 ◽  
pp. 384-385
Author(s):  
M.A. O’Keefe ◽  
J. Taylor ◽  
D. Owen ◽  
B. Crowley ◽  
K.H. Westmacott ◽  
...  
Keyword(s):  
Electron Microscopy ◽  
Electron Microscope ◽  
User Interface ◽  
Transmission Electron Microscope ◽  
High Voltage ◽  
Materials Science ◽  
Transmission Electron ◽  
On Line ◽  
Electron Microscopes

Remote on-line electron microscopy is rapidly becoming more available as improvements continue to be developed in the software and hardware of interfaces and networks. Scanning electron microscopes have been driven remotely across both wide and local area networks. Initial implementations with transmission electron microscopes have targeted unique facilities like an advanced analytical electron microscope, a biological 3-D IVEM and a HVEM capable of in situ materials science applications. As implementations of on-line transmission electron microscopy become more widespread, it is essential that suitable standards be developed and followed. Two such standards have been proposed for a high-level protocol language for on-line access, and we have proposed a rational graphical user interface. The user interface we present here is based on experience gained with a full-function materials science application providing users of the National Center for Electron Microscopy with remote on-line access to a 1.5MeV Kratos EM-1500 in situ high-voltage transmission electron microscope via existing wide area networks. We have developed and implemented, and are continuing to refine, a set of tools, protocols, and interfaces to run the Kratos EM-1500 on-line for collaborative research. Computer tools for capturing and manipulating real-time video signals are integrated into a standardized user interface that may be used for remote access to any transmission electron microscope equipped with a suitable control computer.

Designing a user interface for a pda-based campus navigation device

2004 ◽  
Author(s):  
Brian Dorn ◽  
Daniel Zelik ◽  
Harisudhakar Vepadharmalingam ◽  
Mayukh Ghosh ◽  
S. Keith Adams
Keyword(s):  
User Interface

When a user interface is good enough: User ratings in UI design

2010 ◽  
Author(s):  
Martin L. Fracker ◽  
Michal Heck ◽  
George Goeschel
Keyword(s):  
User Interface ◽  
Ui Design ◽  
User Ratings

A General Model of Drug Prescription

1995 ◽  
Vol 34 (04) ◽  
pp. 310-317 ◽  
Author(s):  
B. Séné ◽  
I. de Zegher ◽  
C. Milstein ◽  
S. Errore ◽  
F de Rosis ◽  
...  
Keyword(s):  
User Interface ◽  
Life Events ◽  
Drug Prescription ◽  
Clinical Signs ◽  
Object Oriented ◽  
Drug Prescriptions ◽  
Free Text ◽  
Medical Procedures ◽  
Dosage Regimens ◽  
Structured Representation

Abstract:Currently, there is no widely accepted structured representation of drug prescription. Nevertheless, a structured representation is required for entering and storing drug prescriptions avoiding free text in computerized systems, and for drug prescription reviews. Derived from part of the work of the European OPADE project, we describe an object-oriented model of drug prescription which incorporates important concepts such as the phase and triggering event concepts. This model can be used to record all drug prescriptions, including infusions, in a structured way avoiding free text. The phase concept allows the storage of sequentially ordered dosage regimens for a drug within the same prescription. The prescription triggering event concept allows recording of the administration of a drug conditional to dates, symptoms and clinical signs, medical procedures, and everyday life events. This model has been implemented within the OPADE project; the corresponding aspects of the user interface are presented to show how this model can be used in practice. Even if other new attributes may be added to the described objects, the structure of this model is suitable for general use in software which requires the entry, storage and processing of drug prescriptions.

Sign in / Sign up

Export Citation Format

Share Document