Visualizing Berio’s Sinfonia: Choreographing Animation for Indeterminate Narratives

In 1968, a year of massive political and cultural upheaval, Luciano Berio composed a score that would shape his legacy. Entitled Sinfonia, which literally means sounding together, the symphony was sparked by the assassination of Martin Luther King. Heralded as “the ultimate pre-postmodernist musical palimpsest” (Service, 2012). Sinfonia reverberates with the political assassinations and massive protests punctuated by police repression that marked 1968. In late 2019, I was offered an animated projection commission with a primary voice in choosing a piece for live symphonic performance/projection. After some researching, I found Berio’s Sinfonia. It had what I was looking for - a “contemporary” piece, it resisted illustration, linear narrative and 19th century romanticism while eschewing the rigid formality of serialism. Instead, it embraced two core Modernist principles – fragmentation and use of the archive. Berio quoted/sampled disparate chunks of literature, music, and events of 1968 in the service of the political and the poetic to discover unity in the heterogeneous. His score seemed ripe for visual interpretation - and exposition - with animation as the prime driver. Following Berio’s lead, I chose visual sampling as my entre and turned to Google. By animating in and out of iconic (and lesser known) images in the orb of 1968, I created a commensurate puzzle piece that mirrored the suggested avant-garde intent I found in Sinfonia – “Where now? Who now? When now?” (Beckett, 1965, p. 291).

Deficit Water Irrigation in an Almond Orchard Can Reduce Pest Damage

Irrigated almond orchards in Spain are increasing in acreage, and it is pertinent to study the effect of deficit irrigation on the presence of pests, plant damage, and other arthropod communities. In an orchard examined from 2017 to 2020, arthropods and diseases were studied by visual sampling under two irrigation treatments (T1, control and T2, regulated deficit irrigation (RDI)). Univariate analysis showed no influence of irrigation on the aphid Hyalopterus amygdali (Blanchard) (Hemiptera: Aphididae) population and damage, but Tetranychus urticae Koch (Trombidiformes: Tetranychidae) damage on leaves was significantly less (50–60% reduction in damaged leaf area) in the T2 RDI treatment compared to the full irrigation T1 control in 2019 and 2020. Typhlocybinae (principal species Asymmetrasca decedens (Paoli) (Hemiptera: Cicadellidae)) population was also significantly lower under T2 RDI treatment. Chrysopidae and Phytoseiidae, important groups in the biological control of pests, were not affected by irrigation treatment. The most important diseases observed in the orchard were not, in general, affected by irrigation treatment. The multivariate principal response curves show significant differences between irrigation strategies in 2019 and 2020. In conclusion, irrigation schemes with restricted water use (such as T2 RDI) can help reduce the foliar damage of important pests and the abundance of other secondary pests in almond orchards.

Pedestrians’ overt attention affects time-to-arrival estimates of oncoming traffic

To navigate safely, pedestrians need to accurately perceive and predict other road users’ motion trajectories. Previous research has shown that the way visual information is sampled affects motion perception. Here we asked how overt attention affects time-to-arrival prediction of oncoming vehicles when viewed from a pedestrian’s point of view in a virtual road-crossing scenario. In three online experiments, we tested time-to-arrival prediction accuracies when observers pursued an approaching vehicle, fixated towards the road-crossing area, fixated towards the road close to the vehicle’s trajectory or were free to view the scene. When the observer-vehicle distance was high, participants displayed a central tendency in their predicted arrival times, indicating that vehicle speed was insufficiently taken into account when estimating its time-to-arrival. This was especially the case when participants fixated towards the road-crossing area, resulting in time-to-arrival overestimation of slow-moving vehicles and underestimation of fast-moving vehicles. The central tendency bias decreased when participants pursued the vehicle or when the eccentricity between the fixation location and the vehicle trajectory was reduced. Our results identify an unfavorable visual sampling strategy as a potential risk factor for pedestrians and suggest that overt attention is best directed towards the direction of the approaching traffic to derive accurate time-to-arrival estimates. To support pedestrian safety, we conclude that the promotion of adequate visual sampling strategies should be considered in both traffic planning and safety training measures.

An examination of active inference in autistic adults using immersive virtual reality

The integration of prior expectations, sensory information, and environmental volatility is proposed to be atypical in Autism Spectrum Disorder, yet few studies have tested these predictive processes in active movement tasks. To address this gap in the research, we used an immersive virtual-reality racquetball paradigm to explore how visual sampling behaviours and movement kinematics are adjusted in relation to unexpected, uncertain, and volatile changes in environmental statistics. We found that prior expectations concerning ball ‘bounciness’ affected sensorimotor control in both autistic and neurotypical participants, with all individuals using prediction-driven gaze strategies to track the virtual ball. However, autistic participants showed substantial differences in visuomotor behaviour when environmental conditions were more volatile. Specifically, uncertainty-related performance difficulties in these conditions were accompanied by atypical movement kinematics and visual sampling responses. Results support proposals that autistic people overestimate the volatility of sensory environments, and suggest that context-sensitive differences in active inference could explain a range of movement-related difficulties in autism.

Decreased Water Use in a Super-Intensive Olive Orchard Mediates Arthropod Populations and Pest Damage

In Spain, water use in agriculture is expected to become limited by resources in the future. It is pertinent to study the effect of decreased irrigation on the presence of pests, plant damage, and arthropod communities in a super-intensive olive orchard examined from 2017 to 2019. Arthropods were studied with visual and vacuum sampling methods in two irrigation treatments (T1—control and T2—Regulated Deficit Irrigation (RDI)). Univariate analyses showed that the total arthropod abundance was significantly greater in T1 than in T2 in 2018 and 2019, mostly due to Diptera Nematocera. Visual sampling revealed that the feeding damage produced by Eriophyidae (Trombidiformes) was significantly lower in T2 in 2018 and 2019: 10–40% of shoots were affected in the late season compared with 50–60% affected for T1. The feeding symptoms caused by Palpita unionalis Hübner (Lepidoptera: Crambidae) and Zelleria oleastrella (Milliere) (Lepidoptera: Yponomeutidae) were significantly less for T2 than for T1. Multivariate principal response curves showed significant differences between irrigation strategies in the 2018 and 2019 data for both sampling methods. In conclusion, irrigation schemes with restricted water use (T2—RDI) help to reduce the abundance of several types of pests in olive crops, especially of those that feed on the plants’ new sprouts.

Visual information sampling in super-recognizers

People’s ability to recognize faces varies to a surprisingly large extent and these differences are hereditary. But cognitive and perceptual processing giving rise to these differences remain poorly understood. Here we compared visual sampling of 10 super-recognizers – individuals that achieve the highest levels of accuracy in face recognition tasks – to typical viewers. Participants were asked to learn, and later recognize, a set of unfamiliar faces while their gaze position was recorded. They viewed faces through ‘spotlight’ apertures varying in size, where the face on the screen was modified in real-time to constrict the visual information displayed to the participant around their gaze position. Higher recognition accuracy in super-recognizers was only observed when at least 36% of the face was visible. We also identified qualitative differences in their visual sampling that can explain their superior recognition accuracy: (1) less systematic focus on the eye region; (2) more fixations to the central region of faces; (3) greater visual exploration of faces in general. These differences were observed in both natural and spotlight viewing conditions, but were most apparent when learning faces and not during recognition. Critically, this suggests that superior recognition performance is founded on enhanced encoding of faces into memory rather than memory retention. Together, our results point to a process whereby super-recognizers construct a more robust memory trace by accumulating samples of complex visual information across successive eye movements.

Expecting the Unexpected: an examination of active inference in autistic adults using immersive virtual reality.

The integration of prior expectations, sensory information, and environmental volatility is proposed to be atypical in Autism Spectrum Disorder, yet few studies have tested these predictive processes in active movement tasks. We used an immersive virtual-reality racquetball paradigm to explore how visual sampling behaviours and movement kinematics are adjusted in relation to unexpected, uncertain, and volatile changes in environmental statistics. We found that prior expectations concerning ball ‘bounciness’ affected sensorimotor control in both autistic and neurotypical participants, with all individuals using prediction-driven gaze strategies to track the virtual ball. However, autistic participants showed substantial differences in visuomotor behaviour when environmental conditions were more volatile. Specifically, uncertainty-related performance difficulties in these conditions were accompanied by atypical movement kinematics and visual sampling behaviours. Results support proposals that autistic people overestimate the volatility of sensory environments, and suggest that context-sensitive differences in active inference could explain a range of movement-related difficulties in autism.

On Senders’s Models of Visual Sampling Behavior

Objective We review the sampling models described in John Senders’s doctoral thesis on “visual sampling processes” via a ready and accessible exposition. Background John Senders left a significant imprint on human factors/ergonomics (HF/E). Here, we focus on one preeminent aspect of his career, namely visual attention. Methods We present, clarify, and expand the models in his thesis through computer simulation and associated visual illustrations. Results One of the key findings of Senders’s work on visual sampling concerns the linear relationship between signal bandwidth and visual sampling rate. The models that are used to describe this relationship are the periodic sampling model (PSM), the random constrained sampling model (RCM), and the conditional sampling model (CSM). A recent replication study that used results from modern eye-tracking equipment showed that Senders’s original findings are manifestly replicable. Conclusions Senders’s insights and findings withstand the test of time and his models continue to be both relevant and useful to the present and promise continued impact in the future. Application The present paper is directed to stimulate a broad spectrum of researchers and practitioners in HF/E and beyond to use these important and insightful models.

Predictive sensorimotor control in autism

Autism spectrum disorder has been characterized by atypicalities in how predictions and sensory information are processed in the brain. To shed light on this relationship in the context of sensorimotor control, we assessed prediction-related measures of cognition, perception, gaze and motor functioning in a large general population (n = 92; Experiment 1) and in clinically diagnosed autistic participants (n = 29; Experiment 2). In both experiments perception and action were strongly driven by prior expectations of object weight, with large items typically predicted to weigh more than equally-weighted smaller ones. Interestingly, these predictive action models were used comparably at a sensorimotor level in both autistic and neurotypical individuals with varying levels of autistic-like traits. Specifically, initial fingertip force profiles and resulting action kinematics were both scaled according to participants’ pre-lift heaviness estimates, and generic visual sampling behaviours were notably consistent across groups. These results suggest that the weighting of prior information is not chronically underweighted in autism, as proposed by simple Bayesian accounts of the disorder. Instead, our results cautiously implicate context-sensitive processing mechanisms, such as precision modulation and hierarchical volatility inference. Together, these findings present novel implications for both future scientific investigations and the autism community.