Optimizing Cycle Time of Industrial Robotic Tasks with Multiple Feasible Configurations at the Working Points

Industrial robot applications should be designed to allow the robot to provide the best performance for increasing throughput. In this regard, both trajectory and task order optimization are crucial, since they can heavily impact cycle time. Moreover, it is very common for a robotic application to be kinematically or functionally redundant so that multiple arm configurations may fulfill the same task at the working points. In this context, even if the working cycle is composed of a small number of points, the number of possible sequences can be very high, so that the robot programmer usually cannot evaluate them all to obtain the shortest possible cycle time. One of the most well-known problems used to define the optimal task order is the Travelling Salesman Problem (TSP), but in its original formulation, it does not allow to consider different robot configurations at the same working point. This paper aims at overcoming TSP limitations by adding some mathematical and conceptual constraints to the problem. With such improvements, TSP can be used successfully to optimize the cycle time of industrial robotic tasks where multiple configurations are allowed at the working points. Simulation and experimental results are presented to assess how cost (cycle time) and computational time are influenced by the proposed implementation.

Social learning in swarm robotics

In this paper, we present an implementation of social learning for swarm robotics. We consider social learning as a distributed online reinforcement learning method applied to a collective of robots where sensing, acting and coordination are performed on a local basis. While some issues are specific to artificial systems, such as the general objective of learning efficient (and ideally, optimal) behavioural strategies to fulfill a task defined by a supervisor, some other issues are shared with social learning in natural systems. We discuss some of these issues, paving the way towards cumulative cultural evolution in robot swarms, which could enable complex social organization necessary to achieve challenging robotic tasks. This article is part of a discussion meeting issue ‘The emergence of collective knowledge and cumulative culture in animals, humans and machines’.

Quantifying changes over 1 year in motor and cognitive skill after transient ischemic attack (TIA) using robotics

Recent work has highlighted that people who have had TIA may have abnormal motor and cognitive function. We aimed to quantify deficits in a cohort of individuals who had TIA and measured changes in their abilities to perform behavioural tasks over 1 year of follow-up using the Kinarm Exoskeleton robot. We additionally considered performance and change over time in an active control cohort of migraineurs. Individuals who had TIA or migraine completed 8 behavioural tasks that assessed cognition as well as motor and sensory functionality in the arm. Participants in the TIA cohort were assessed at 2, 6, 12, and 52 weeks after symptom resolution. Migraineurs were assessed at 2 and 52 weeks after symptom resolution. We measured overall performance on each task using an aggregate metric called Task Score and quantified any significant change in performance including the potential influence of learning. We recruited 48 individuals to the TIA cohort and 28 individuals to the migraine cohort. Individuals in both groups displayed impairments on robotic tasks within 2 weeks of symptom cessation and also at approximately 1 year after symptom cessation, most commonly in tests of cognitive-motor integration. Up to 51.3% of people in the TIA cohort demonstrated an impairment on a given task within 2-weeks of symptom resolution, and up to 27.3% had an impairment after 1 year. In the migraine group, these numbers were 37.5% and 31.6%, respectively. We identified that up to 18% of participants in the TIA group, and up to 10% in the migraine group, displayed impairments that persisted for up to 1 year after symptom resolution. Finally, we determined that a subset of both cohorts (25–30%) experienced statistically significant deteriorations in performance after 1 year. People who have experienced transient neurological symptoms, such as those that arise from TIA or migraine, may continue to experience lasting neurological impairments. Most individuals had relatively stable task performance over time, with some impairments persisting for up to 1 year. However, some individuals demonstrated substantial changes in performance, which highlights the heterogeneity of these neurological disorders. These findings demonstrate the need to consider factors that contribute to lasting neurological impairment, approaches that could be developed to alleviate the lasting effects of TIA or migraine, and the need to consider individual neurological status, even following transient neurological symptoms.

Inferring Time-delayed Causal Relations in POMDPs from the Principle of Independence of Cause and Mechanism

This paper introduces an algorithm for discovering implicit and delayed causal relations between events observed by a robot at regular or arbitrary times, with the objective of improving data-efficiency and interpretability of model-based reinforcement learning (RL) techniques. The proposed algorithm initially predicts observations with the Markov assumption, and incrementally introduces new hidden variables to explain and reduce the stochasticity of the observations. The hidden variables are memory units that keep track of pertinent past events. Such events are systematically identified by their information gains. A test of independence between inputs and mechanisms is performed to identify cases when there is a causal link between events and those when the information gain is due to confounding variables. The learned transition and reward models are then used in a Monte Carlo tree search for planning. Experiments on simulated and real robotic tasks, and the challenging 3D game Doom show that this method significantly improves over current RL techniques.

Building Affordance Relations for Robotic Agents - A Review

Affordances describe the possibilities for an agent to perform actions with an object. While the significance of the affordance concept has been previously studied from varied perspectives, such as psychology and cognitive science, these approaches are not always sufficient to enable direct transfer, in the sense of implementations, to artificial intelligence (AI)-based systems and robotics. However, many efforts have been made to pragmatically employ the concept of affordances, as it represents great potential for AI agents to effectively bridge perception to action. In this survey, we review and find common ground amongst different strategies that use the concept of affordances within robotic tasks, and build on these methods to provide guidance for including affordances as a mechanism to improve autonomy. To this end, we outline common design choices for building representations of affordance relations, and their implications on the generalisation capabilities of an agent when facing previously unseen scenarios. Finally, we identify and discuss a range of interesting research directions involving affordances that have the potential to improve the capabilities of an AI agent.