出版社：Eesti Rakenduslingvistika Ühing (Estonian Association for Applied Linguistics)
摘要：The article elaborates on the structure of a multimodal act,and thereby also the underlying cognitive processes.The current paper presents a study on the basis of empirical data concerning utilization of communication modalities on transmission and successful reception of the meaning in a situation with concurrent presence of objects in the communicative space.The analyzed materials originate from corpora of audio- and videotape recordings of native inhabitants from shore villages of the lake Peipus (Research Group on Multimodal Communication,University of Tartu).The method of microanalysis of video recordings as well as theories of multimodal communication were employed in the research.The method and theoretical term base were combined pursuant to the data under analysis.Five people participated in the communication situation and the conversation took place in Russian.The analysis encompasses identification of the conversational topic and description of the physical space,movements and linguistic aspects.The first example concerns the interaction of speech,physical surroundings and movements in pointing to the referent,and the resultant structure of the multimodal communicative act.It is concluded that hand movement enables one to create a relationship between a word and its referent because the indicative gesture reveals the location of the referent.As a result,the speaker shortens verbal descriptions of the referent and uses more deictic words for signifying the referent.It is possible to use one movement for pointing simultaneously to various objects,stressing one or another object by different parts of utterance and body movement (head,hand gestures).The second example analyzes movements utilized for introducing objects located elsewhere and objecst present as the visual basis of representation.The integral meaning is formed by the interaction of many multimodal acts.Cognitive abilities (including the memory of the communicator) play an important part in this process.The introduction of a new referent during several communication acts is also signified by means of various modalities.The integral meaning during depiction of a referent is created from a complex multimodal structure,which involves the interaction of the following components in transmission of the final meaning: a) deictic words and elliptical grammatical constructions for designation of the depicted referent,b) visual basis for depiction,c) a memorized referent,which was depicted earlier,and d) alteration of the form and number of movements in marking the introduction of a new referent.Therefore,a communicative act,which incorporates the direction of movements and location in reference to the visual basis and memorized previous referent as well as deictic words and elliptic constructions,constitutes the multimodal representation of a respective referent.
其他摘要：Artikkel toob esile,millised on mitme osalejaga multimodaalses suhtlussituatsioonis seosed modaalsuste vahel tähenduste kujundamisel ja vastuvõtmisel.Teoreetiliselt lähtume suhtlusakti struktuuri analüüsist ning keskendume multimodaalsele kommunikatsioonile.Näitame,millisel viisil on mitme osalejaga suhtluses võimalik kasutada osalejate kommunikatiivset potentsiaali,et edastada ja vastu võtta tähendusi ning sooritada konkreetseid suhtlustegevusi.Analüüs toob välja osalejate verbaalsete ja mitteverbaalsete suhtlusmodaalsuste rolli tähenduse konstrueerimisel ja üksteise mõistmisel,kui kujutatakse referenti või osutatakse sellele.Andmed pärinevad Peipsi järve rannakülade elanike suhtlussituatsioonide audio- ja videosalvestuste korpusest,mis on lindistatud loomulikus situatsioonis välitingimustes.
关键词：multimodal communication;multiparty situation;structure of communicative act;meaning;Russian;Estonian
其他关键词：multimodaalne suhtlus;mitme osalejaga situatsioon;suhtlusakti struktuur;tähendus;vene keel;eesti keel
