scholarly journals What you see depends on what you hear: temporal averaging and crossmodal integration

2018 ◽  
Author(s):  
Lihan Chen ◽  
Xiaolin Zhou ◽  
Hermann J. Müller ◽  
Zhuanghua Shi

AbstractIn our multisensory world, we often rely more on auditory information than on visual input for temporal processing. One typical demonstration of this is that the rate of auditory flutter assimilates the rate of concurrent visual flicker. To date, however, this auditory dominance effect has largely been studied using regular auditory rhythms. It thus remains unclear whether irregular rhythms would have a similar impact on visual temporal processing; what information is extracted from the auditory sequence that comes to influence visual timing; and how the auditory and visual temporal rates are integrated together in quantitative terms. We investigated these questions by assessing, and modeling, the influence of a task-irrelevant auditory sequence on the type of ‘Ternus apparent motion’: group motion versus element motion. The type of motion seen critically depends on the time interval between the two Ternus display frames. We found that an irrelevant auditory sequence preceding the Ternus display modulates the visual interval, making observers perceive either more group motion or more element motion. This biasing effect manifests whether the auditory sequence is regular or irregular, and it is based on a summary statistic extracted from the sequential intervals: their geometric mean. However, the audiovisual interaction depends on the discrepancy between the mean auditory and visual intervals: if it becomes too large, no interaction occurs – which can be quantitatively described by a partial Bayesian integration model. Overall, our findings reveal a crossmodal perceptual averaging principle that may underlie complex audiovisual interactions in many everyday dynamic situations.Public Significance StatementThe present study shows that auditory rhythms, regardless of their regularity, can influence the way in which the visual system times (subsequently presented) events, thereby altering dynamic visual (motion) perception. This audiovisual temporal interaction is based on a summary statistic derived from the auditory sequence: the geometric mean interval, which is then combined with the visual interval in a process of partial Bayesian integration (where integration is unlikely to occur if the discrepancy between the auditory and visual intervals is too large). We propose that this crossmodal perceptual averaging principle underlies complex audiovisual interactions in many everyday dynamic perception scenarios.Author NoteThis study was supported by grants from the Natural Science Foundation of China (31200760, 61621136008, 61527804), German DFG project SH166 3/1 and “projektbezogener Wissenschaftleraustausch” (proWA). The data, and the source code of statistical analysis and modeling are available at https://github.com/msenselab/temporal_averaging. Part of the study has been presented as a talk in 17th International Multisensory Research Forum (IMRF, June 2016, Suzhou, China).

Perception ◽  
10.1068/p5670 ◽  
2008 ◽  
Vol 37 (12) ◽  
pp. 1790-1804 ◽  
Author(s):  
Darko Odic ◽  
Jay Pratt

The Ternus display produces a bistable illusion of motion: at very short interstimulus intervals (ISIs; < 30 ms) observers perceive element motion while at longer ISIs (> 30 ms) observers perceive group motion. In experiment 1, however, we find that, when the Ternus display's ISI contains an occluding box, group motion is mostly eliminated. These results do not fit the predictions made by the short-range/long-range two-process theory [Braddick and Adlard, 1978, in Visual Psychophysics and Psychology (New York: Academic Press)]. We propose that the differential-activation theory (Gilroy et al, 2001 Perception & Psychophysics63 847–861) accounts for our results. We then extend the differential-activation theory as an explanatory mechanism for the Ternus display in experiment 2 by selectively placing an occluder over the first, second, or third Ternus display element. As predicted by the differential-activation theory, the occlusion of the far-left element produced a normal distribution of group motion increasing with ISI, while the occlusion of the other two elements produced an illusion of occluded elements remaining stationary throughout the display. Furthermore, as predicted by the differential-activation theory, each moving element was assigned to its nearest neighbour, producing, in the case of second and third element occlusion, a novel Ternus display motion illusion where only two out of three elements are perceived as moving.


2020 ◽  
Vol 56 (4) ◽  
pp. 19-31
Author(s):  
Andrea Pompigna ◽  
Raffaele Mauro

This paper deals with a Structural Decomposition (SDA) applied to the analysis of the freight traffic demand in an Input Output (IO) modelling context. After reviewing the basic definitions of IO models and some methodological refer-ences for their application in the freight transport field, the paper proposes the application of the SDA in the perspec-tive of a freight corridor. This application takes place downstream of an IO model that directly relates the quantities of goods transported along the corridor with the functioning of the reference economic system. Considering the evolution of tons annually transported in a certain time interval, the SDA model allows to isolate the specific effects related to: intensity of freight traffic typical of the corridor; technological structure of the production sectors; characteristics of the final demand in relation to its overall level, sectoral structure and allocation between components. The SDA model is applied to a case study considering the total volumes of goods annually in transit at the Brenner pass between 2000 and 2014. The evaluation of the polar forms of the multiplicative decomposition and their geometric mean allow to quantify the effects of each factor on the variation of the tonnage in terms of indexed value, absolute variation and percentage contribution compared to the base year (2000). The relative influences on freight traffic at the Brenner pass are therefore highlighted, both in terms of total volumes transited and impacts attributable to each of the decomposi-tion factors introduced, with particular evidence also in the event of periods of economic and financial crisis. The SDA specified in the paper and the related case study provide useful elements for studying the traffic demand of goods through a freight corridor, helping in outlining the effects of the different driving forces related to the economic system and affecting freight transport demand trends.


2018 ◽  
Vol 72 (4) ◽  
pp. 1-5
Author(s):  
Elżbieta Włodarczyk ◽  
Agata Szkiełkowska ◽  
Adam Piłka

Introduction: Distorted processing of auditory information has a negative impact on the child’s cognitive development. There are only a few studies conducted by Polish researchers determining the normative values of psychoacoustic tests in auditory processing disorders. They are inconsistent due to different methodologies and different research protocols. Objective: The aim of the work was to determine the reference values of selected psychoacoustic tests for the population of Polish children between 7 and 12 years of age. Material and method: The study group consisted of 213 healthy children from 7 to 12 years of age. The condition for including the child in the study was an intellectual norm, proper sound sensitivity, proper development of children’s voice and speech. All children underwent two auditory temporal processing tests. The diagnostic procedure used a standardized Frequency Pattern Test (FPT) and Duration Pattern Test (DPT). The tests were carried out in accordance with the authors' recommendations, using the original versions available on the CD for 60 dB SL intensity, simultaneously for the right and left ear. Results: The reference values for FPT and DPT tests were determined at various age ranges in children aged 7-12. It has been shown that auditory functions change with age and development of the child. Reference values including age, language, cultural and educational differences were prepared. Conclusions: The development of reference values for individual tests for the Polish children population is a key element in the reliable diagnosis of auditory processing.


Blood ◽  
1995 ◽  
Vol 85 (4) ◽  
pp. 925-928 ◽  
Author(s):  
RJ Soiffer ◽  
C Murray ◽  
J Ritz ◽  
N Phillips ◽  
D Jacobsohn ◽  
...  

The administration of low doses of recombinant interleukin-2 (rIL-2) in vivo to patients with malignant neoplasms has been demonstrated to selectively increase the number of circulating natural killer (NK) cells in these patients. Recent evidence from SCID mouse models suggests that IgG subclass levels can be influenced by the presence and activity of NK cells. Therefore, we sought to examine the effect of rIL- 2 infusions on human serum IgG subclass concentrations. We determined serum IgG subclass concentrations in 27 cancer patients receiving low- dose rIL-2 by daily continuous intravenous infusion. Eleven of these patients had active, metastatic, nonhematologic tumors; 16 patients had received IL-2 when they were in a minimal residual disease state after autologous or allogeneic bone marrow transplantation. Samples obtained before beginning IL-2 therapy and 8 to 10 weeks into therapy were tested. Treatment with IL-2 resulted in an increase in the percentage of CD56+ NK cells from 18% to 54% (P = .0001). A significant decrease in geometric mean IgG2 concentration from 2,017 micrograms/mL to 1,655 micrograms/mL was noted over this time interval (P = .03). Furthermore, the geometric mean IgG2 concentration after treatment was significantly lower than that of healthy controls (P = .026). In contrast, no significant changes in serum IgG1, IgG3, or IgG4 were noted during r- IL2 infusions. Our data suggest that rIL-2 treatment selectively decreases serum IgG2 concentrations. We speculate that increased NK cells mediate downregulation of human serum IgG2.


1983 ◽  
Vol 61 (8) ◽  
pp. 1783-1792 ◽  
Author(s):  
Larry D. Witzel ◽  
Hugh R. MacCrimmon

Effects of three homogeneous gravels (2.7, 6.2 and 9.2 mm in diameter) and five heterogeneous gravel mixtures (with 0, 20, 40, 60 and 80% sand; geometric mean diameters = 14.2, 10.1, 7.2, 5.1, 3.7 mm, respectively) on embryo survival and subsequent emergence of brook charr (Salvelinus fontinalis) and brown trout (Salmo trutta) were examined in the laboratory using vertical flow incubators. Differences in survival to emergence, temporal components of emergence and developmental stage of emergents are significant [Formula: see text] among gravel types within and between species. Alevin survival, time interval to first and 50% emergence and duration of emergence period vary directly with gravel size and inversely with sand concentration. Survivals of 0 to 20% occurred in unigranular gravels 6.2 mm or finer and in multitextured gravels with 60% or more sand and rates of 60 to 96% were found in 9.2-mm gravel and gravels with 20% or less sand. Emergent survival increased from 14 to 79% in gravels of 6.2 to 9.2 mm and from 2 to 96% in sand concentrations between 60 and 20% because of reduced entrapment. Period of emergence was longest in 9.2-mm gravel (mean for charr, 381 day degrees; mean for trout, 423 day degrees) and in 0% sand–gravel mixture (mean for charr, 232 day degrees; mean for trout, 179 day degrees). Premature emergence of alevins over a shortened emergence period in finer gravels is identified as a stress response. Larger gravel and lower sand concentrations produced the largest and most advanced alevins at emergence. Ecological implications of the results are examined.


Perception ◽  
10.1068/p3444 ◽  
2005 ◽  
Vol 34 (6) ◽  
pp. 669-685 ◽  
Author(s):  
Anna Ma-Wyatt ◽  
Colin W G Clifford ◽  
Peter Wenderoth

We investigated whether the same principles that influence grouping in static displays also influence grouping in apparent motion. Using the Ternus display, we found that the proportion of group motion reports was influenced by changes in contrast configuration. Subjects made judgments of completion of these same configurations in a static display. Generally, contrast configurations that induced a high proportion of group motion responses were judged as more ‘complete’ in static displays. Using a stereo display, we then tested whether stereo information and T-junction information were critical for this increase in group motion. Perceived grouping was consistently higher for same contrast polarity configurations than for opposite contrast polarity configurations, regardless of the presence of stereo information or explicit T-junctions. Thus, while grouping in static and moving displays showed a similar dependence on contrast configuration, motion grouping showed little dependence on stereo or T-junction information.


2005 ◽  
Vol 1278 ◽  
pp. 373-376 ◽  
Author(s):  
Yoshiko Mochizuki ◽  
Shigeki Takeuchi ◽  
Hiroaki Masaki ◽  
Noriyoshi Takasawa ◽  
Katuo Yamazaki

2021 ◽  
Vol 21 (6) ◽  
pp. 1909-1919
Author(s):  
Dieter R. Poelman ◽  
Wolfgang Schulz ◽  
Stephane Pedeboy ◽  
Dustin Hill ◽  
Marcelo Saba ◽  
...  

Abstract. Information about lightning properties is important in order to advance the current understanding of lightning, whereby the characteristics of ground strike points (GSPs) are in particular helpful to improving the risk estimation for lightning protection. Lightning properties of a total of 1174 negative downward lightning flashes are analyzed. The high-speed video recordings are taken in different regions, including Austria, Brazil, South Africa and the USA, and are analyzed in terms of flash multiplicity, duration, interstroke intervals and ground strike point properties. According to our knowledge this is the first simultaneous analysis of GSP properties in different regions of the world applying a common methodology. Although the results vary among the data sets, the analysis reveals that a third of the flashes are single-stroke events, while the overall mean number of strokes per flash equals 3.67. From the video imagery an average of 1.56 GSPs per flash is derived, with about 60 % of the multiple-stroke flashes striking the ground in more than one place. It follows that a ground contact point is struck 2.35 times on average. Multiple-stroke flashes last on average 371 ms, whereas the geometric mean (GM) interstroke interval value preceding strokes producing a new GSP is about 18 % greater than the GM value preceding subsequent strokes following a pre-existing lightning channel. In addition, a positive correlation between the duration and multiplicity of the flash is presented. The characteristics of the subset of flashes exhibiting multiple GSPs is further examined. It follows that strokes with a stroke order of 2 create a new GSP in 60 % of the cases, while this percentage quickly drops for higher-order strokes. Further, the possibility of forming a new lightning channel to ground in terms of the number of strokes that conditioned the previous lightning channel shows that approximately 88 % developed after the occurrence of only one stroke. Investigating the time intervals in the other 12 % of the cases when two or more strokes re-used the previous lightning channel showed that the average interstroke time interval preceding a new lightning channel is found to be more than twice the time difference between strokes that follow the previous lightning channel.


Author(s):  
Jamileh Chupani ◽  
Mohanna Javanbakht ◽  
Yones Lotfi

Background and Aim: The majority of the world’s population is bilingual. Bilingualism is a form of sensory enrichment that translates to gains in cognitive abilities; these cognitive gains in attention and memory are known to modulate subcortical processing of auditory stimuli. Sec­ond language acquisition has a broad impact on various psychological, cognitive, memory, and linguistic processes. Central auditory processing (CAP) is the perceptual processing of auditory information. Due to its importance in bilingu­alism, this study aimed to review the CAP of bilinguals. Recent Findings: The CAP was studied in three areas: dichotic listening, temporal processing, and speech in noise perception. Regarding dicho­tic listening, studies have shown that bilinguals have better performance in staggered spondaic word (SSW) test, consonant-vowel dichotic test, dichotic digits test (DDT), and disyllable dichotic test than monolinguals, although similar results have also been reported in SSW and DDT. Reg­arding temporal processing, the results of bilin­guals do not differ from those of monolinguals, although in some cases, it is better in bilinguals. Regarding speech in noise perception, the results between bilinguals and monolinguals are varied depending on the amount of linguistic infor­mation available in the stimuli. Conclusion: Bilingualism has a positive effect on dichotic processing, no effect on temporal processing, and varied effect on speech in noise perception. Bilinguals have poor performance using meaningful speech and better performance using meaningless speech. Keywords: Central auditory processing; bilingual; dichotic listening; temporal processing; speech in noise perception


2021 ◽  
Author(s):  
Dieter R. Poelman ◽  
Wolfgang Schulz ◽  
Stephane Pedeboy ◽  
Dustin Hill ◽  
Marcelo Saba ◽  
...  

Abstract. Lightning properties of a total of 1174 negative downward lightning flashes are analyzed. The high-speed video recordings are taken in different regions around the world, including Austria, Brazil, South Africa and USA, and are analyzed in terms of flash multiplicity, duration, interstroke intervals and ground strike point (GSP) properties. Although the results vary among the data sets, the analysis reveals that a third of the flashes are single-stroke events, while the overall mean number of strokes per flash equals 3.67. From the video imagery an average of 1.56 GSPs per flash is derived, with about 60 % of the multiple stroke flashes striking ground in more than one place. It follows that the channel creating a GSP is re-used by a factor of 2.3. Multiple-stroke flashes last on average 371 ms, whereas the geometric mean (GM) interstroke interval value preceding strokes producing a new GSP is about 18 % greater than the GM value preceding subsequent strokes following a pre-existing channel. In addition, a positive correlation between the duration and multiplicity of the flash is presented. The characteristics of the subset of flashes exhibiting multiple GSPs is further examined. It follows that strokes with stroke order of two create a new GSP in 60 % of the cases, while this percentage quickly drops for higher order strokes. Further, the possibility to form a new channel to ground in terms of the number of strokes that conditioned the previous channel shows that approximately 88 % developed after the occurrence of only one stroke. Investigating the time intervals in the other 12 % of the cases when two or more strokes re-used the previous channel showed that the average interstroke time interval preceding a new channel is found to be more than twice the time difference between strokes that follow the previous channel.


Sign in / Sign up

Export Citation Format

Share Document