scholarly journals Optimization and learning for rough terrain legged locomotion

2011 ◽  
Vol 30 (2) ◽  
pp. 175-191 ◽  
Author(s):  
Matt Zucker ◽  
Nathan Ratliff ◽  
Martin Stolle ◽  
Joel Chestnutt ◽  
J Andrew Bagnell ◽  
...  
Keyword(s):  
Optimal Control ◽  
Past Research ◽  
Legged Locomotion ◽  
Control Technique ◽  
Rough Terrain ◽  
Inverse Optimal Control ◽  
Novel Approach ◽  
Planning Framework ◽  
Robot Behavior ◽  
High Level

We present a novel approach to legged locomotion over rough terrain that is thoroughly rooted in optimization. This approach relies on a hierarchy of fast, anytime algorithms to plan a set of footholds, along with the dynamic body motions required to execute them. Components within the planning framework coordinate to exchange plans, cost-to-go estimates, and ‘certificates’ that ensure the output of an abstract high-level planner can be realized by lower layers of the hierarchy. The burden of careful engineering of cost functions to achieve desired performance is substantially mitigated by a simple inverse optimal control technique. Robustness is achieved by real-time re-planning of the full trajectory, augmented by reflexes and feedback control. We demonstrate the successful application of our approach in guiding the LittleDog quadruped robot over a variety of types of rough terrain. Other novel aspects of our past research efforts include a variety of pioneering inverse optimal control techniques as well as a system for planning using arbitrary pre-recorded robot behavior.

scholarly journals Deep Reinforcement Learning for End-to-End Local Motion Planning of Autonomous Aerial Robots in Unknown Outdoor Environments: Real-Time Flight Experiments

Sensors ◽  
2021 ◽  
Vol 21 (7) ◽  
pp. 2534
Author(s):  
Oualid Doukhi ◽  
Deok-Jin Lee
Keyword(s):  
Reinforcement Learning ◽  
Real Time ◽  
Autonomous Navigation ◽  
Control Technique ◽  
Local Motion ◽  
Aerial Robots ◽  
Novel Approach ◽  
Outdoor Environments ◽  
Aerial Vehicle ◽  
High Level

Autonomous navigation and collision avoidance missions represent a significant challenge for robotics systems as they generally operate in dynamic environments that require a high level of autonomy and flexible decision-making capabilities. This challenge becomes more applicable in micro aerial vehicles (MAVs) due to their limited size and computational power. This paper presents a novel approach for enabling a micro aerial vehicle system equipped with a laser range finder to autonomously navigate among obstacles and achieve a user-specified goal location in a GPS-denied environment, without the need for mapping or path planning. The proposed system uses an actor–critic-based reinforcement learning technique to train the aerial robot in a Gazebo simulator to perform a point-goal navigation task by directly mapping the noisy MAV’s state and laser scan measurements to continuous motion control. The obtained policy can perform collision-free flight in the real world while being trained entirely on a 3D simulator. Intensive simulations and real-time experiments were conducted and compared with a nonlinear model predictive control technique to show the generalization capabilities to new unseen environments, and robustness against localization noise. The obtained results demonstrate our system’s effectiveness in flying safely and reaching the desired points by planning smooth forward linear velocity and heading rates.

scholarly journals Fuzzy Logic for Intelligent Control System Using Soft Computing Applications

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2617
Author(s):  
Catalin Dumitrescu ◽  
Petrica Ciotirnae ◽  
Constantin Vizitiu
Keyword(s):  
Decision Making ◽  
Fuzzy Logic ◽  
Soft Computing ◽  
Intelligent Control ◽  
Fuzzy Controller ◽  
Control Technique ◽  
Distributed Intelligence ◽  
High Level ◽  
The Impact ◽  
Fuzzy Subsets

When considering the concept of distributed intelligent control, three types of components can be defined: (i) fuzzy sensors which provide a representation of measurements as fuzzy subsets, (ii) fuzzy actuators which can operate in the real world based on the fuzzy subsets they receive, and, (iii) the fuzzy components of the inference. As a result, these elements generate new fuzzy subsets from the fuzzy elements that were previously used. The purpose of this article is to define the elements of an interoperable technology Fuzzy Applied Cell Control-soft computing language for the development of fuzzy components with distributed intelligence implemented on the DSP target. The cells in the network are configured using the operations of symbolic fusion, symbolic inference and fuzzy–real symbolic transformation, which are based on the concepts of fuzzy meaning and fuzzy description. The two applications presented in the article, Agent-based modeling and fuzzy logic for simulating pedestrian crowds in panic decision-making situations and Fuzzy controller for mobile robot, are both timely. The increasing occurrence of panic moments during mass events prompted the investigation of the impact of panic on crowd dynamics and the simulation of pedestrian flows in panic situations. Based on the research presented in the article, we propose a Fuzzy controller-based system for determining pedestrian flows and calculating the shortest evacuation distance in panic situations. Fuzzy logic, one of the representation techniques in artificial intelligence, is a well-known method in soft computing that allows the treatment of strong constraints caused by the inaccuracy of the data obtained from the robot’s sensors. Based on this motivation, the second application proposed in the article creates an intelligent control technique based on Fuzzy Logic Control (FLC), a feature of intelligent control systems that can be used as an alternative to traditional control techniques for mobile robots. This method allows you to simulate the experience of a human expert. The benefits of using a network of fuzzy components are not limited to those provided distributed systems. Fuzzy cells are simple to configure while also providing high-level functions such as mergers and decision-making processes.

scholarly journals Towards a contemporary player learning in development framework for sports practitioners

2021 ◽  
pp. 174795412110023
Author(s):  
Mark O Sullivan ◽  
Carl T Woods ◽  
James Vaughan ◽  
Keith Davids
Keyword(s):  
Linear Process ◽  
Task Environment ◽  
Coach Education ◽  
Development Framework ◽  
Novel Approach ◽  
Non Linear ◽  
And Performance ◽  
Learning Development ◽  
High Level ◽  
User Friendly

As it is appreciated that learning is a non-linear process – implying that coaching methodologies in sport should be accommodative – it is reasonable to suggest that player development pathways should also account for this non-linearity. A constraints-led approach (CLA), predicated on the theory of ecological dynamics, has been suggested as a viable framework for capturing the non-linearity of learning, development and performance in sport. The CLA articulates how skills emerge through the interaction of different constraints (task-environment-performer). However, despite its well-established theoretical roots, there are challenges to implementing it in practice. Accordingly, to help practitioners navigate such challenges, this paper proposes a user-friendly framework that demonstrates the benefits of a CLA. Specifically, to conceptualize the non-linear and individualized nature of learning, and how it can inform player development, we apply Adolph’s notion of learning IN development to explain the fundamental ideas of a CLA. We then exemplify a learning IN development framework, based on a CLA, brought to life in a high-level youth football organization. We contend that this framework can provide a novel approach for presenting the key ideas of a CLA and its powerful pedagogic concepts to practitioners at all levels, informing coach education programs, player development frameworks and learning environment designs in sport.

Anti‐disturbance inverse optimal control for systems with disturbances

2021 ◽  
Author(s):  
Zhong‐Xin Fan ◽  
Avizit Chandra Adhikary ◽  
Shihua Li ◽  
Rongjie Liu
Keyword(s):  
Optimal Control ◽  
Inverse Optimal Control

scholarly journals Production and process management: An optimal control approach

2016 ◽  
Vol 26 (3) ◽  
pp. 331-342 ◽  
Author(s):  
Haider Biswas ◽  
Ahad Ali
Keyword(s):  
Optimal Control ◽  
Process Management ◽  
Nonlinear Dynamical Systems ◽  
State Constraint ◽  
Control Technique ◽  
Optimal Control Strategy ◽  
Nonlinear Dynamical ◽  
Control Approach ◽  
Time Operation ◽  
Operation Process

Optimal control and efficient management of industrial products are the key for sustainable development in industrial and process engineering. It is well-known that proper maintenance of process performance, ensuring the quality products after a long time operation of the system, is desirable in any industry. Nonlinear dynamical systems may play crucial role to appropriately design the model and obtain optimal control strategy in production and process management. This paper deals with a mathematical model in terms of ordinary differential equations (ODEs) that describe control of production and process arising in industrial engineering. The optimal control technique in the form of maximum principle, used to control the quality products in the operation processes, is applied to analyze the model. It is shown that the introduction of state constraint can be advantageous for obtaining good products during the longer operation process. We investigate the model numerically, using some known nonlinear optimal control solvers, and we present the simulation results to illustrate the significance of introducing state constraint onto the dynamics of the model.

Sign in / Sign up

Export Citation Format

Share Document