scholarly journals Gestures as image schemas and force gestalts: A dynamic systems approach augmented with motion-capture data analyses

2018 ◽  
Vol 11 (1) ◽  
Author(s):  
Irene Mittelberg
Keyword(s):  
Material Culture ◽  
Motion Capture ◽  
Dynamic Systems ◽  
Systems Approach ◽  
Meaning Making ◽  
Self Regulation ◽  
Spatial Relation ◽  
The Body ◽  
Motion Capture Data ◽  
Image Schemas

AbstractEmbodied image schemas are central to experientialist accounts of meaning-making. Research from several disciplines has evidenced their pervasiveness in motivating form and meaning in both literal and figurative expressions across diverse semiotic systems and art forms (e.g., Gibbs and Colston; Hampe; Johnson; Lakoff; and Mandler). This paper aims to highlight structural similarities between, on the one hand, dynamic image schemas and force schemas and, on the other, hand shapes and gestural movements. Such flexible correspondences between conceptual and gestural schematicity are assumed to partly stem from experiential bases shared by incrementally internalized conceptual structures and the repeated gestural (re-) enacting of bodily actions as well as more abstractsemantic primitives(Lakoff). Gestures typically consist of evanescent, metonymically reduced hand configurations, motion onsets, or movement traces that minimally suggest, for instance, a PATH, the idea of CONTAINMENT, an IN-OUT spatial relation, or the momentary loss of emotional BALANCE. So, while physical in nature, gestures often emerge as rather schematic gestalts that, as such, have the capacity to vividly convey essential semantic and pragmatic aspects of high relevance to the speaker. It is further argued that gesturally instantiated image schemas and force dynamics are inherently meaningful structures that typically underlie more complex semantic and pragmatic processes involving, for instance, metonymy, metaphor, and frames. First, I discuss previous work on how image schemas, force gestalts, and mimetic schemas may underpin hand gestures and body postures. Drawing on Gibbs’ dynamic systems account of image schemas, I then introduce an array of tendencies in gestural image schema enactments:body-inherent/self-oriented(body as image-schematic structure; forces acting upon the body);environment-oriented(material culture including spatial structures), andinterlocutor-oriented(intersubjective understanding). Adopting a dynamic systems perspective (e.g.,Thompson and Varela) thus puts the focus on how image schemas and force gestalts that operate in gesture may function as cognitive-semiotic organizing principles that underpin a) the physical and cognitive self-regulation of speakers; b) how they interact with the (virtual) environment while talking; and c) intersubjective instances of resonance and understanding between interlocutors or between an artwork and its beholder. Examples of these patterns are enriched by video and motion-capture data, showing how numeric kinetic data allow one to measure the temporal and spatial dimensions of gestural articulations and to visualize movement traces.

scholarly journals Descripción del movimiento humano basado en el marco de Frenet Serret y datos tipo MOCAP

2021 ◽  
Vol 17 (34) ◽  
pp. 170-180
Author(s):  
Juan Camilo Hernandez-Gomez ◽  
Alejandro Restrepo-Martínez ◽  
Juliana Valencia-Aguirre
Keyword(s):  
Motion Capture ◽  
Nearest Neighbors ◽  
Human Movement ◽  
The Body ◽  
Microsoft Kinect ◽  
Support Vector ◽  
Motion Capture Data ◽  
K Nearest Neighbors ◽  
Vector Machines ◽  
Optical Markers

Clasificar el movimiento humano se ha convertido en una necesidad tecnológica, en donde para definir la posición de un sujeto requiere identificar el recorrido de las extremidades y el tronco del cuerpo, y tener la capacidad de diferenciar esta posición respecto a otros sujetos o movimientos, generándose la necesidad tener datos y algoritmos que faciliten su clasificación. Es así, como en este trabajo, se evalúa la capacidad discriminante de datos de captura de movimiento en rehabilitación física, donde la posición de los sujetos es adquirida con el Kinect de Microsoft y marcadores ópticos, y atributos del movimiento generados con el marco de Frenet Serret, evaluando su capacidad discriminante con los algoritmos máquinas de soporte vectorial, redes neuronales y k vecinos más cercanos. Los resultados presentan porcentajes de acierto del 93.5% en la clasificación con datos obtenidos del Kinect, y un éxito del 100% para los movimientos con marcadores ópticos. Classify human movement has become a technological necessity, where defining the position of a subject requires identifying the trajectory of the limbs and trunk of the body, having the ability to differentiate this position from other subjects or movements, which generates the need to have data and algorithms that help their classification. Therefore, the discriminant capacity of motion capture data in physical rehabilitation is evaluated, where the position of the subjects is acquired with the Microsoft Kinect and optical markers. Attributes of the movement generated with the Frenet Serret framework. Evaluating their discriminant capacity by means of support vector machines, neural networks, and k nearest neighbors algorithms. The obtained results present an accuracy of 93.5% in the classification with data obtained from the Kinect, and success of 100% for movements where the position is defined with optical markers.

From Verbal to Three-dimensional Digital Visual Texts: A Construction of a Javanese Prince

2020 ◽  
Author(s):  
Harry Nuriman ◽  
◽  
Nia Kurniasih ◽  
Setiawan Sabana ◽  
Intan R. Mutiaz ◽  
...  
Keyword(s):  
Motion Capture ◽  
Electronic Devices ◽  
Three Dimensional ◽  
The Body ◽  
Motion Capture Data ◽  
Visual Texts ◽  
Theatrical Performances ◽  
Physical Features ◽  
Capture Technique

Visualizations of the body of the famous Javanese Prince Diponegoro appears in various media, ranging across sketches, paintings, sculptures, banknotes and coins, shadow puppets, stamps, theatrical performances and electronic devices. All these visualizations mostly follow previous visualizations influenced by artist imaginations. This research seeks to present Prince Diponegoro in three-dimensional animated visualization using a motion capture technique. To complete this, the project draws from authentic manuscript research from the autobiography of Babad Diponegoro. Further, the project employs intertextuality as a method with which to interpolate the data, and hence to obtain a satisfactory overall visualization. The physical features, gestures and paralinguistic elements contained in the verbal text of Babad Diponegoro have been employed using motion capture data based on events written in the Babad Diponegoro. Many existing representations of the prince exist. However, this study attempts to rethink these existing visualizations, so as to produce a much more accurate, if not completely new, icon, thus differing to existing representations.

Development of meaning making: A dynamic systems approach

2000 ◽  
Vol 18 (1) ◽  
pp. 57-82 ◽  
Author(s):  
E.Saskia Kunnen ◽  
Harke A Bosma
Keyword(s):  
Dynamic Systems ◽  
Systems Approach ◽  
Meaning Making

scholarly journals Choreographed Soft Morphologies: exploring new ways of ideating soft architecture through material elasticity

2018 ◽  
pp. 60-73
Author(s):  
Marina Castán ◽  
Daniel Suárez
Keyword(s):  
Motion Capture ◽  
Interaction Design ◽  
Architectural Design ◽  
Meaning Making ◽  
The Body ◽  
Digital Design ◽  
Raw Material ◽  
Custom Made ◽  
Elastic Interface ◽  
Soft Architecture

This research aims to contribute to the current field of architectural design by offering evidence of how a collaborative and embodied approach to soft architecture can inform a new physical-digital design process. Current design technologies (e.g. sensors, 3D scanners, procedural modelling software), together with the use of the body as a source for designing a space, offer new methods and tools for designing architecture (Hirschberg, Sayegh, Frühwirth and Zedlacher 2006). However, the potential for experiencing and digitally capturing a soft and elastic material interaction through the body as a dynamic system capable of informing soft architectural design has not yet been widely explored. By using the felt experience as a tool for design, we allow the material to express its qualities when activated by the body, revealing its form instead of it being imposed from outside (DeLanda 2015). Taking an embodied approach used in interaction design and fashion design (Loke and Robertson 2011; Wilde, Vallgårda, and Tomico 2017), this research proposes a hybrid method to explore a textile-body ontology as an entity that has the potential to design a space, along with the use of motion capture technology in an effort to re-connect the experiential (the body) with the architecture (the space). Through a custom-made interface, made of soft and hard materials, we explored the dynamic and spatial qualities of material elasticity through choreographed body movements. The interface acts as a deformable space that can be shaped by the body, producing a collection of form expressions, ranging from subtle surface modifications to more prominent deformations. Such form-giving processes were captured in real time by three Kinect sensors, offering a distinct digital raw material that can be conveniently manipulated and translated into architectural simulations, validating the method as a new way to inform soft architectural design processes. The findings showed that: 1) the direct experience of collaboratively interacting with a soft and elastic interface allows the identification of the dynamic qualities of the material in relation to oneself and others, facilitating an immediate spatial meaning-making process; 2) exploring the design of a soft and elastic space through choreography and motion capture technology contributes to the creation of augmented relational scales across physical and digital realms, proposing a new hybrid design method; 3) the soft and elastic interface becomes a new entity when shaped by the body (textile-body ontology) giving the opportunity for a variety of formal expressions and offering a source of digital raw material for architectural design.

scholarly journals Towards an embodied poetics of cinema

2012 ◽  
pp. 50-67
Author(s):  
Maarten Coëgnarts ◽  
Peter Kravanja
Keyword(s):  
Meaning Making ◽  
Meaning Construction ◽  
The Body ◽  
Human Beings ◽  
Conceptual Metaphor Theory ◽  
Cinema Studies ◽  
Image Schemas ◽  
Metaphor Theory ◽  
To Come ◽  
The Aesthetic

Central to Conceptual Metaphor Theory (CMT) is the notion of embodied mind, which states that cognition is shaped by aspects of the body. Human beings make metaphoric use of recurring dynamic patterns of perceptual interactions and motor programmes (image schemas) for abstract conceptualisation and reasoning. According to film scholar David Bordwell the poetics of cinema studies the film as a result of a process of construction. He presents the following key question: how do film-makers use the aesthetic dynamics of the film medium to elicit particular effects from spectators? In this article we want to address an abbreviated case of meaning construction in film, namely the construction of abstract meaning in film. By combining insights from Bordwell as well as CMT, we will demonstrate how the poetics of abstract meaning-making in film is embodied. What does it mean to say that the construction of higher meaning in film is rooted in bodily experience and how can this be grasped without resorting to the confinement of words and sentences? By analysing the stylistics and the visual patterning of particular film scenes we will demonstrate how film-makers often resort to image schemas to come to terms with abstract notions such as time, love and psychological content.

Turning the World Upside Down

2018 ◽  
Vol 36 (2) ◽  
pp. 198-223
Author(s):  
Veronica Dittman Stanich
Keyword(s):  
Material Culture ◽  
Meaning Making ◽  
Historical Analysis ◽  
The Body ◽  
Head Orientation ◽  
Multiple Perspectives ◽  
Culture Studies ◽  
Dance Training ◽  
Postmodern Dance ◽  
The World

A particular movement – inverting the body to a tail-over-head orientation and fleetingly taking weight on the hands – has been a staple of postmodern dance training and choreography since the early 1990s, yet it remains unnamed and uncodified. Taking a material culture studies approach, I examine this movement closely, using interviews, observation, historical analysis, and a survey of dance practitioners to situate this not-exactly-a-handstand within the field of American postmodern dance. These multiple perspectives yield new insights into the field, its practitioners, and its relationship to the larger cultural picture. I find embodied in this transitional, upside-down movement not only postmodern dance's countercultural and eclectic inheritance but also the conflicted cultural space it occupies. Postmodern dance is old enough to have a tradition, but doesn't want to relinquish its maverick identity; meanwhile, its meaning-making codes are inaccessible to much of the general public even as it begs a bigger audience in order to thrive.

Self-Regulation Shift Theory: A Dynamic Systems Approach to Traumatic Stress

2017 ◽  
Vol 30 (4) ◽  
pp. 333-342 ◽  
Author(s):  
Charles C. Benight ◽  
Kotaro Shoji ◽  
Douglas L. Delahanty
Keyword(s):  
Dynamic Systems ◽  
Traumatic Stress ◽  
Systems Approach ◽  
Self Regulation

scholarly journals Dynamic coupling: intrinsic and extrinsic influences on reaching and grasping in children with hemiplegic cerebral palsy

2017 ◽  
pp. 24
Author(s):  
David Sugden
Keyword(s):  
Cerebral Palsy ◽  
Dynamic Systems ◽  
Systems Approach ◽  
The Body ◽  
Dynamic Coupling ◽  
Bimanual Movement ◽  
Hemiplegic Cerebral Palsy

The purpose of the present study was to investigate the influence of task and organismic constraints on the dynamic coupling, during reaching and touching, and reaching and grasping tasks in individuals with hemiplegic cerebral palsy. Executions with a hand and with both hands were compared. Thus, three different studies were acomplished: 1) envolving reaching and touching; and reaching and grasping; 2) envolving the same tasks, with under speed pressure; 3) envolving the same tasks, but with a change in the angle of the table upon which the object rested. In generally, the results showed a coupling between the body sides during the bimanual movement. The influence of the constraints introduced in the task was different among the subjects. The results of this study were discussed in the light of the dynamic systems approach, which emphasizes the role of organismic, task and environment constraint upon behavior

The Embodiment of Language

2018 ◽  
pp. 622-640
Author(s):  
Mark Johnson
Keyword(s):  
Philosophy Of Language ◽  
Cognitive Linguistics ◽  
Meaning Making ◽  
Body Part ◽  
The Body ◽  
Natural Languages ◽  
Image Schemas ◽  
Affective Processes ◽  
Semantics And Pragmatics

Analytic philosophy of language was originally based on a fundamentally disembodied view of meaning and language. In contrast, research in cognitive linguistics and neuroscience emphasizes the central role of the body and brain in shaping meaning, concepts, and thought. Meaning is not, in the first instance, linguistic. Instead, language depends on and recruits prior sensory, motor, and affective processes. This article surveys some of the more important embodied structures and processes of meaning-making that give rise to the syntax, semantics, and pragmatics of natural languages. This includes body-part projections, perceptual concepts, image schemas, emotions, body-based grammatical constructions, and conceptual metaphors, as those are understood from the perspective of simulation semantics, embodied construction grammar, and the neural theory of language. In addition to the four Es of cognition—embodied, embedded, enactive, extended—we need to add three more Es—emotional, evolutionary, and exaptative.

scholarly journals A Novel Biomechanical Analysis of Horticultural Digging

2017 ◽  
Vol 27 (6) ◽  
pp. 746-753 ◽  
Author(s):  
James Shippen ◽  
Paul Alexander ◽  
Barbara May
Keyword(s):  
Motion Capture ◽  
The Body ◽  
Contact Forces ◽  
Biomechanical Analysis ◽  
Motion Capture Data ◽  
Joint Angles ◽  
Joint Torques ◽  
Risk Of Injury ◽  
Joint Contact ◽  
Good Technique

Musculoskeletal injuries are commonly reported in workers employed in labor-intensive agricultural-type tasks. A novel method of determining joint angles, joint torques, and contact forces, using three-dimensional motion capture and musculoskeletal modeling, was applied to the movements of a sample of workers, engaged in the horticultural task of digging, to determine if objective biomechanical data could be correlated with a subjective visual assessment to predict risk of injury. The joint angle time histories of horticulturists were calculated from the motion capture data, and this was used to articulate a musculoskeletal model of the subjects. The joint torques were calculated using inverse dynamics methods from which the individual muscle loads were established using a cost function minimization approach. Finally, the joint contact forces were calculated including the muscle forces. The motion capture data of digging trials were observed by a team of horticulturists and physiotherapists who categorized each of the observed trials according to form, efficiency, and risk of injury. Trials demonstrating techniques which were more likely to yield injuries were identified as “examples of bad technique”; those judged to be less likely to yield injuries were categorized as “examples of good technique.” It was found that the joint torques and contact forces and their variability were lower in the trial which was identified as good technique, and consistently higher in the examples of bad technique. The results of the study suggest that measurement of joint angles, joint torques, joint contact forces, and forces in the muscles could serve as a valuable tool to develop training programs for horticultural workers engaged in certain high intensity tasks, such as digging, to effectively improve efficiency and reduce incidence of injury. It may also be possible to modify horticulture-related equipment to minimize the internal loads within the body to reduce the risk to health and, therefore, extend active participation in horticulture.

Sign in / Sign up

Export Citation Format

Share Document