Recent Perspectives On Gesture And Multimodality

Author : Anabela Cruz-Santos,Isabel Galhano-Rodrigues,Elena Zagar Galvão
Publisher : Cambridge Scholars Publishing
Page : 184 pages
File Size : 54,9 Mb
Release : 2019-07-14
Category : Language Arts & Disciplines
ISBN : 9781527536876

Get Book

Recent Perspectives on Gesture and Multimodality by Anabela Cruz-Santos,Isabel Galhano-Rodrigues,Elena Zagar Galvão Pdf

What is gesture and what does it do? What is the meaning of multimodality? What do these concepts signify within the different theoretical approaches to interaction and communication among human beings? Why do we study gesture and multimodality? The thirteen chapters that make up this volume provide answers to these questions. They bring together an eclectic set of recent studies on visible bodily actions conducted by junior and senior researchers and are a testimony to the curiosity and vitality that have always distinguished gesture studies. This young yet rapidly growing field investigates the semiotic features of gesture in relation to speech as integral parts of utterances, the different uses of gestures with and without speech, such as gestures in language acquisition, gestures in the performing arts (music, dance, theatre) and gestures in Artificial Intelligence.

Author : Ruth Page
Publisher : Routledge
Page : 243 pages
File Size : 43,6 Mb
Release : 2009-09-10
Category : Language Arts & Disciplines
ISBN : 9781135254612

Get Book

New Perspectives on Narrative and Multimodality by Ruth Page Pdf

The contributors in this collection question what kinds of relationships hold between narrative studies and the recently established field of multimodality, evaluate how we might develop an analytical vocabulary which recognizes that stories do not consist of words alone, and demonstrate the ways in which multimodality brings into fresh focus the embodied nature of narrative production and processing. Engaging with a spectrum of multimodal storytelling, from ‘low tech’ examples encompassing face-to-face stories, comic books, printed literature, through to opera, film adaptation and television documentary, stretching beyond to narratives that employ new media such as hypertext, performance art, and interactive museum guides, this volume examines the interplay of semiotic codes (visual, oral, aural, haptic, physiological) within each case under scrutiny, thereby exposing both points of commonality and difference in the range of multimodal narrative experiences.

Author : Eija Ventola,Cassily Charles,Martin Kaltenbacher
Publisher : John Benjamins Publishing
Page : 260 pages
File Size : 42,8 Mb
Release : 2004-01-01
Category : Language Arts & Disciplines
ISBN : 9789027232069

Get Book

Perspectives on Multimodality by Eija Ventola,Cassily Charles,Martin Kaltenbacher Pdf

This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.

Author : Jean-Marc Colletta,Michèle Guidetti
Publisher : John Benjamins Publishing
Page : 236 pages
File Size : 49,9 Mb
Release : 2012
Category : Language Arts & Disciplines
ISBN : 9789027202581

Get Book

Gesture and Multimodal Development by Jean-Marc Colletta,Michèle Guidetti Pdf

Brings together studies from language acquisition and developmental psychology. This title addresses topics such as: gesture use in prelinguistic infants with a focus on pointing, the relationship between gestures and lexical development in typically developing and deaf children and even how gesture can help to learn mathematics

Author : Jana Bressem
Publisher : Walter de Gruyter GmbH & Co KG
Page : 253 pages
File Size : 49,9 Mb
Release : 2021-09-07
Category : Language Arts & Disciplines
ISBN : 9783110697995

Get Book

Repetitions in Gesture by Jana Bressem Pdf

Repetitive sequences play a major role as a pattern-building device and are a basic syntagmatic linguistic means on all language levels in spoken and signed languages. Little attention has been paid to investigating them in multimodal language use. Do gestures exhibit different types of repetitive sequences? Do they build complex units based on these types and if so, how is the pattern building to be described? How is the interrelation of gestural and spoken units in such complex units? Is it possible to identify repetitive patterns that are comparable to spoken and signed languages and/or patterns specific to the gestural modality? Based on a corpus-analysis of multimodal usage-events, 7 chapters explore gestural repetitions with regard to their structure, semantic and syntactic relevance for multimodal utterances, and cognitive saliency. Fine-grained cognitive-linguistic analyses of multimodal usage events reveal that gestural repetitions are not only a basic principle of building patterns in spoken and signed languages, but also in gestures. By addressing questions of mediality and multimodality of language-in-use, the book contributes to the investigation of repetition as a fundamental means of sign and meaning construction (crosscutting modalities) and enhances the understanding of the multimodal character of language in use.

Author : Carla Fernandes,Vito Evola,Cláudia Ribeiro
Publisher : Taylor & Francis
Page : 332 pages
File Size : 50,7 Mb
Release : 2022-09-08
Category : Performing Arts
ISBN : 9781000556193

Get Book

Dance Data, Cognition, and Multimodal Communication by Carla Fernandes,Vito Evola,Cláudia Ribeiro Pdf

Dance Data, Cognition, and Multimodal Communication is the result of a collaborative and transdisciplinary effort towards a first definition of "dance data", with its complexities and contradictions, in a time where cognitive science is growing in parallel to the need of a renewed awareness of the body’s agency in our manyfold interactions with the world. It is a reflection on the observation of bodily movements in artistic settings, and one that views human social interactions, multimodal communication, and cognitive processes through a different lens—that of the close collaboration between performing artists, designers, and scholars. This collection focuses simultaneously on methods and technologies for creating, documenting, or representing dance data. The editors highlight works focusing on the dancers’ embodied minds, including research using neural, cognitive, behavioural, and linguistic data in the context of dance composition processes. Each chapter deals with dance data from an interdisciplinary perspective, presenting theoretical and methodological discussions emerging from empirical studies, as well as more experimental ones. The book, which includes digital Support Material on the volume's Routledge website, will be of great interest to students and scholars in contemporary dance, neuro-cognitive science, intangible cultural heritage, performing arts, cognitive linguistics, embodiment, design, new media, and creativity studies.

Author : Alan J. Cienki
Publisher : Distinguished Lectures in Cogn
Page : 198 pages
File Size : 42,8 Mb
Release : 2017
Category : Language Arts & Disciplines
ISBN : 900433209X

Get Book

Ten Lectures on Spoken Language and Gesture from the Perspective of Cognitive Linguistics by Alan J. Cienki Pdf

"Cognitive linguistics is purported to be a usage-based approach, yet only recently has research in some of its subfields turned to spontaneous spoken (versus written) language data. The collection of Alan Cienki's 'Ten Lectures on Spoken Language and Gesture from the Perspective of Cognitive Linguistics' considers what it means to apply different approaches from within this field to the dynamic, multimodal combination of speech and gesture. The lectures encompass such main paradigms as blending and mental space theory, conceptual metaphor and metonymy, construction and cognitive grammars, image schemas, and mental simulation in relation to semantics. Overall, Alan Cienki shows that taking the usage-based commitment seriously with audio-visual data raises new issues and questions for theoretical models in cognitive linguistics."--Cover page 4.

Author : Antonio Camurri,Gualtiero Volpe
Publisher : Springer
Page : 571 pages
File Size : 47,6 Mb
Release : 2011-04-02
Category : Computers
ISBN : 9783540245988

Get Book

Gesture-Based Communication in Human-Computer Interaction by Antonio Camurri,Gualtiero Volpe Pdf

Research on the multifaceted aspects of modeling, analysis, and synthesis of - man gesture is receiving growing interest from both the academic and industrial communities. On one hand, recent scienti?c developments on cognition, on - fect/emotion, on multimodal interfaces, and on multimedia have opened new perspectives on the integration of more sophisticated models of gesture in c- putersystems.Ontheotherhand,theconsolidationofnewtechnologiesenabling “disappearing” computers and (multimodal) interfaces to be integrated into the natural environments of users are making it realistic to consider tackling the complex meaning and subtleties of human gesture in multimedia systems, - abling a deeper, user-centered, enhanced physical participation and experience in the human-machine interaction process. The research programs supported by the European Commission and s- eral national institutions and governments individuated in recent years strategic ?elds strictly concerned with gesture research. For example, the DG Infor- tion Society of the European Commission (www.cordis.lu/ist) supports several initiatives, such as the “Disappearing Computer” and “Presence” EU-IST FET (Future and Emerging Technologies), the IST program “Interfaces & Enhanced Audio-Visual Services” (see for example the project MEGA, Multisensory - pressive Gesture Applications, www.megaproject.org), and the IST strategic - jective “Multimodal Interfaces.” Several EC projects and other funded research are represented in the chapters of this book. Awiderangeofapplicationscanbene?tfromadvancesinresearchongesture, from consolidated areas such as surveillance to new or emerging ?elds such as therapy and rehabilitation, home consumer goods, entertainment, and aud- visual, cultural and artistic applications, just to mention only a few of them.

Author : Jean-Marc Colletta,Michèle Guidetti
Publisher : John Benjamins Publishing
Page : 237 pages
File Size : 41,5 Mb
Release : 2012-06-13
Category : Language Arts & Disciplines
ISBN : 9789027273925

Get Book

Gesture and Multimodal Development by Jean-Marc Colletta,Michèle Guidetti Pdf

We gesture while we talk and children use gestures prior to words to communicate during the first year. Later, as words become the preferred form of communication, children continue to gesture to reinforce or extend the spoken messages or even to replace them. This volume, originally published as a Special Issue of Gesture 10:2/3 (2010), brings together studies from language acquisition and developmental psychology. It provides a review of common theoretical, methodological and empirical themes, and the contributions address topics such as gesture use in prelinguistic infants with a special and new focus on pointing, the relationship between gestures and lexical development in typically developing and deaf children and even how gesture can help to learn mathematics. All in all, it brings additional evidence on how gestures are related to language, communication and mind development.

Author : Ruth Page
Publisher : Routledge
Page : 242 pages
File Size : 52,7 Mb
Release : 2009-09-10
Category : Language Arts & Disciplines
ISBN : 9781135254605

Get Book

New Perspectives on Narrative and Multimodality by Ruth Page Pdf

The contributors in this collection question what kinds of relationships hold between narrative studies and the recently established field of multimodality, evaluate how we might develop an analytical vocabulary which recognizes that stories do not consist of words alone, and demonstrate the ways in which multimodality brings into fresh focus the embodied nature of narrative production and processing. Engaging with a spectrum of multimodal storytelling, from ‘low tech’ examples encompassing face-to-face stories, comic books, printed literature, through to opera, film adaptation and television documentary, stretching beyond to narratives that employ new media such as hypertext, performance art, and interactive museum guides, this volume examines the interplay of semiotic codes (visual, oral, aural, haptic, physiological) within each case under scrutiny, thereby exposing both points of commonality and difference in the range of multimodal narrative experiences.

Author : Silva Ladewig
Publisher : Walter de Gruyter GmbH & Co KG
Page : 254 pages
File Size : 41,5 Mb
Release : 2020-07-20
Category : Language Arts & Disciplines
ISBN : 9783110668650

Get Book

Integrating Gestures by Silva Ladewig Pdf

Gestures are now viewed as an integral part of spoken language. But little attention has been paid to the recipients’ cognitive processes of integrating both gesture and speech. How do people understand a speaker’s gestures when inserted into gaps in the flow of speech? What cognitive-semiotic mechanisms allow this integration to occur? And what linguistic and gestural properties do people draw on when construing multimodal meaning? This book offers answers by investigating multimodal utterances in which speech is replaced by gestures. Through fine-grained cognitive-linguistic and cognitive-semiotic analyses of multimodal utterances combined with naturalistic perception experiments, six chapters explore gestures’ potential to realize grammatical notions of nouns and verbs and to integrate with speech by merging into multimodal syntactic constructions. Analyses of speech-replacing gestures and a range of related phenomena compel us to consider gestures as well as spoken and signed language as manifestations of the same conceptual system. An overarching framework is proposed for studying these different modalities together – a multimodal cognitive grammar.

Author : Peter Hühn,Wolf Schmid,Jörg Schönert
Publisher : Walter de Gruyter
Page : 312 pages
File Size : 53,7 Mb
Release : 2009
Category : Language Arts & Disciplines
ISBN : 9783110218909

Get Book

Point of View, Perspective, and Focalization by Peter Hühn,Wolf Schmid,Jörg Schönert Pdf

Stories do not actually exist in the world but are created and structured- modeled- through the process of mediation, i.e. through the means and techniques by which they are represented. This is an important field, not only for narratology but a

Author : Mari Hatavara,Matti Hyvärinen,Maria Mäkelä,Frans Mäyrä
Publisher : Routledge
Page : 327 pages
File Size : 51,9 Mb
Release : 2015-06-19
Category : Literary Criticism
ISBN : 9781317524625

Get Book

Narrative Theory, Literature, and New Media by Mari Hatavara,Matti Hyvärinen,Maria Mäkelä,Frans Mäyrä Pdf

Offering an interdisciplinary approach to narrative, this book investigates storyworlds and minds in narratives across media, from literature to digital games and reality TV, from online sadomasochism to oral history databases, and from horror to hallucinations. It addresses two core questions of contemporary narrative theory, inspired by recent cognitive-scientific developments: what kind of a construction is a storyworld, and what kind of mental functioning can be embedded in it? Minds and worlds become essential facets of making sense and interpreting narratives as the book asks how story-internal minds relate to the mind external to the storyworld, that is, the mind processing the story. With essays from social scientists, literary scholars, linguists, and scholars from interactive media studies answering these topical questions, the collection brings diverse disciplines into dialogue, providing new openings for genuinely transdisciplinary narrative theory. The wide-ranging selection of materials analyzed in the book promotes knowledge on the latest forms of cultural and social meaning-making through narrative, necessary for navigating the contemporary, mediatized cultural landscape. The combination of theoretical reflection and empirical analysis makes this book an invaluable resource for scholars and advanced students in fields including literary studies, social sciences, art, media, and communication.

Author : Pixel
Publisher : libreriauniversitaria.it Edizioni
Page : 718 pages
File Size : 40,6 Mb
Release : 2016-03-04
Category : Education
ISBN : 9788862927055

Get Book

Conference Proceeding. New Perspectives in Scienze Education by Pixel Pdf

Author : Darren K. LaScotte,Corinne S. Mathieu,Samuel S. David
Publisher : Springer Nature
Page : 290 pages
File Size : 52,6 Mb
Release : 2022-05-31
Category : Education
ISBN : 9783030981167

Get Book

New Perspectives on Material Mediation in Language Learner Pedagogy by Darren K. LaScotte,Corinne S. Mathieu,Samuel S. David Pdf

This volume distinguishes itself from existing research on materials design, development, and evaluation, and focuses on material mediation in actual processes of teaching and learning, a subject that has been under-researched in the field of applied linguistics and second language education. This edited volume includes diverse perspectives on the roles that materials play in language learner pedagogy. Moving beyond the field of English language teaching, readers will find novel contributions offering a diversity of language teaching contexts, learner populations, and topics in the theory and/or practice of second and foreign language teaching. Chapters explore the ways in which affordances and constraints of classroom materials impact teachers and learners, while at the same time they bring their own (evolving) resources, identities, beliefs, and expertise to modify and adapt the materials to better suit their local language teaching and learning environments. As such, this text is ideal for use as supplemental reading in a wide variety of applied linguistics, second/foreign language education, TESOL, and instructional course design courses.