Speech Driven Gaze in a Face-to-Face Interaction

Gaze and language are major pillars in multimodal communication. Gaze is a non-verbal mechanism that conveys crucial social signals in face-to-face conversation. However, compared to language, gaze has been less studied as a communication modality. The purpose of the present study is 2-fold: (i) to investigate gaze direction (i.e., aversion and face gaze) and its relation to speech in a face-to-face interaction; and (ii) to propose a computational model for multimodal communication, which predicts gaze direction using high-level speech features. Twenty-eight pairs of participants participated in data collection. The experimental setting was a mock job interview. The eye movements were recorded for both participants. The speech data were annotated by ISO 24617-2 Standard for Dialogue Act Annotation, as well as manual tags based on previous social gaze studies. A comparative analysis was conducted by Convolutional Neural Network (CNN) models that employed specific architectures, namely, VGGNet and ResNet. The results showed that the frequency and the duration of gaze differ significantly depending on the role of participant. Moreover, the ResNet models achieve higher than 70% accuracy in predicting gaze direction.

When narrative practice suddenly goes online due to COVID-19 …

This article is a reflective consolidation of our practice experience in Hong Kong during the COVID-19 period, in which social work educators and practitioners needed to work online in a prolonged period of social distancing. It illustrates in what ways online practices may denote emerging knowledge and skills that are worth further discussion. These reflections have been consolidated as four knowledge/skill domains in our afterthoughts: i) Context, ii) Conversation, iii) Communication-Modality, and iv) Circulation. These insights may inspire social work educators and practitioners to comprehend the potential of media technologies more fully.

Inter-body coupling in electro-quasistatic human body communication: theory and analysis of security and interference properties

Radiative communication using electromagnetic fields is the backbone of today’s wirelessly connected world, which implies that the physical signals are available for malicious interceptors to snoop within a 5–10 m distance, also increasing interference and reducing channel capacity. Recently, Electro-quasistatic Human Body Communication (EQS-HBC) was demonstrated which utilizes the human body’s conductive properties to communicate without radiating the signals outside the body. Previous experiments showed that an attack with an antenna was unsuccessful at a distance more than 1 cm from the body surface and 15 cm from an EQS-HBC device. However, since this is a new communication modality, it calls for an investigation of new attack modalities—that can potentially exploit the physics utilized in EQS-HBC to break the system. In this study, we present a novel attack method for EQS-HBC devices, using the body of the attacker itself as a coupling surface and capacitive inter-body coupling between the user and the attacker. We develop theoretical understanding backed by experimental results for inter-body coupling, as a function of distance between the subjects. We utilize this newly developed understanding to design EQS-HBC transmitters that minimizes the attack distance through inter-body coupling, as well as the interference among multiple EQS-HBC users due to inter-body coupling. This understanding will allow us to develop more secure and robust EQS-HBC based body area networks in the future.

Preference for Alternative Communication Modality Based on Reinforcer Quality and Availability

Preference for augmentative or alternative communication (AAC) systems has received growing interest in work with individuals with developmental disabilities. An individual may choose a modality based on technological (e.g., auditory-output) or aesthetic features of a system; however, it is ideal that functional features (i.e., effectiveness in producing a reinforcer) affect preference to a much greater extent. Prior research has treated preference as a static variable and may commonly report a lack of preference for a modality or control by irrelevant features of the assessment (e.g., position of the modality in an array). The current study assessed the preference for AAC modalities of a teenager with autism spectrum disorder and intellectual disability using a concurrent-chains procedure. This study extended prior research by including additional methods to ensure accurate assessment of preference (i.e., a control condition) and a reinforcer manipulation to determine whether preference was controlled by non-functional (e.g., aesthetic) or functional (i.e., reinforcer quality and availability) variables. Preference was found to be functionally related to reinforcer availability, including when rapidly alternated between modalities. Moreover, the participant consistently allocated responding away from the control condition. Implications for self-determination and suggestions for future research on preference for AAC systems are considered.

Uptake and patient and provider communication modality preferences of virtual visits in primary care: a retrospective cohort study in Canada

ObjectivesTo evaluate the uptake of a platform for virtual visits in primary care, examine patient and physician preferences for virtual communication methods and report on characteristics of visits and patients experience of care.DesignA retrospective cohort study.SettingPrimary care practices within five regions in Ontario, Canada after 18 months of access to virtual care services.Participants326 primary care providers and 14 291 registered patients.InterventionsProviders used a platform that allowed them to connect with their patients through synchronous (audio/video) and/or asynchronous (secure messaging) communication.Main outcome measuresUser-level data from the platforms including patient demographics, practice characteristics, communication modality used, visit characteristics and patients’ satisfaction.ResultsAmong the participants, 44% of registered patients and 60% of registered providers used the platform at least once. Among patient users, 51% completed at least one virtual visit. The majority of virtual visits (94%) involved secure messaging. The most common patient requests were for medication prescriptions (24%) and follow-up from previous appointment (22%). The most common provider request was to follow-up on test results (59%). Providers indicated that 81% of virtual visits required no follow-up for that issue and 99% of patients reported that they would use virtual care services again.ConclusionsWhile there are a growing number of primary care video visit services, our study found that both patients and providers in rostered practices prefer secure messaging over video. Despite fears that virtual visits would be overused by patients, when patients connected with their own primary care provider, many virtual visits appeared to replace in-person visits, and patients did not overwhelm physicians with requests. This approach may improve access and continuity in primary care.

Optimizing Military Human-Robot Teaming: An Evaluation of Task Load and Modality Switch Cost

The effect of task switching on performance has been examined in many different fields and contexts. Sudden changes in task load can significantly impair performance, which can have detrimental consequences in dismounted military operations. As technology is advancing, robots are sought to take on the role of a teammate to the human soldier in the field. Robot-to-human communication modality may need to switch when mayhem occurs in military missions. Modality switching has been associated with performance decrements, although these effects are largely unknown in military human-robot teaming situations. The present study examined the cost associated with switching task demand and robot-to-human communication modality type on performance in a simulated cordon-and-search mission. The results showed that switches in task load affected threat detection performance. Auditory reporting increased performance more than visual reporting in low-after-high task load epochs. Performance with auditory reports was also higher in high-after-low demand blocks than low-after-high. The effect of switching needs to be taken into account for high-stakes human-robot interactions.

Communication Modalities Used in the Delivery of Extension Programs to Small Scale Livestock Raisers in San Jose, Occidental Mindoro, Philippines

This study was conducted to determine the communication modalities used in extension program offered to livestock raisers in San Jose, Occidental Mindoro, Philippines. This study utilized the descriptive research method. The data were collected through questionnaire. All data was organized, classified, and interpreted using descriptive statistics. Results show that the small scale livestock raisers in San Jose, Occidental Mindoro were mostly male, middle aged, with low level of education and had been raising not more than five heads of livestock. Majority have a long experience of livestock production. Most of them rated the quality of support services provided to them as “good”. One-on-one method is the most common communication modality used by the extension workers, however, the preferred modality is the conduct of seminar/conferences. The problems encountered on the adoption of technologies were the financial constraint, lack of institutional support, and the mismatch of the message and the communication media used by the extension worker.