skip to main content
10.1145/3212721.3212850acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmocoConference Proceedingsconference-collections
short-paper

The role of emotion in movement segmentation

Published: 28 June 2018 Publication History

Abstract

Humans understand ongoing events by breaking reality into meaningful units through a process named "event segmentation". In psychology, theories such as the "Event Segmentation theory" have been proposed to illustrate how humans perceive the structure of ongoing behavior. Parsing discrete gestures from a continuous movement stream is also a necessary step for movement analysis. Many approaches towards automatic emotion recognition from full body movement leverage automatic segmentation methods. Nonetheless, to the best of my knowledge, no framework has applied Event Segmentation theory to the automatic segmentation of emotion conveying movements. In this paper, I propose the exploitation of a computational model of event segmentation to extend a movement-analysis framework with an event segmentation module.

References

[1]
Jernej Barbič, Alla Safonova, Jia-Yu Pan, Christos Faloutsos, Jessica K Hodgins, and Nancy S Pollard. 2004. Segmenting motion capture data into distinct behaviors. In Proceedings of Graphics Interface 2004. Canadian Human-Computer Communications Society, 185--194.
[2]
Antonio Camurri, Ingrid Lagerlöf, and Gualtiero Volpe. 2003. Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. International journal of human-computer studies 59, 1-2 (2003), 213--225.
[3]
Ginevra Castellano, Santiago D Villalba, and Antonio Camurri. 2007. Recognising human emotions from body movement and gesture dynamics. In International Conference on Affective Computing and Intelligent Interaction. Springer, 71--82.
[4]
Ajo Fod, Maja J Matarić, and Odest Chadwicke Jenkins. 2002. Automated derivation of primitives for movement classification. Autonomous robots 12, 1 (2002), 39--54.
[5]
Kanav Kahol, Priyamvada Tripathi, and Sethuraman Panchanathan. 2004. Automated gesture segmentation from dance sequences. In Automatic Face and Gesture Recognition, 2004. Proceedings. Sixth IEEE International Conference on. IEEE, 883--888.
[6]
Christopher A Kurby and Jeffrey M Zacks. 2008. Segmentation in the perception and memory of events. Trends in cognitive sciences 12, 2 (2008), 72--79.
[7]
Dani Levine, Kathy Hirsh-Pasek, Amy Pace, and Roberta Michnick Golinkoff. 2017. A goal bias in action: The boundaries adults perceive in events align with sites of actor intent. Journal of Experimental Psychology: Learning, Memory, and Cognition 43, 6 (2017), 916.
[8]
Darren Newtson. 1973. Attribution and the unit of perception of ongoing behavior. Journal of Personality and Social Psychology 28, 1 (1973), 28.
[9]
Darren Newtson and Gretchen Engquist. 1976. The perceptual organization of ongoing behavior. Journal of Experimental Social Psychology 12, 5 (1976), 436--450.
[10]
A Ogale, Alap Karapurkar, Gutemberg Guerra-Filho, and Yiannis Aloimonos. 2004. View-invariant identification of pose sequences for action recognition. In Video Analysis and Content Extraction Workshop (VACE), Vol. 14. Citeseer.
[11]
Amol Patwardhan. 2017. Three-Dimensional, Kinematic, Human Behavioral Pattern-Based Features for Multimodal Emotion Recognition. Multimodal Technologies and Interaction 1, 3 (2017), 19.
[12]
Stefano Piana, Alessandra Staglianò, Francesca Odone, and Antonio Camurri. 2016. Adaptive body gesture representation for automatic emotion recognition. ACM Transactions on Interactive Intelligent Systems (TiiS) 6, 1 (2016), 6.
[13]
Jeremy R Reynolds, Jeffrey M Zacks, and Todd S Braver. 2007. A computational model of event segmentation from perceptual prediction. Cognitive Science 31, 4 (2007), 613--643.
[14]
Nicole K Speer, Jeffrey M Zacks, and Jeremy R Reynolds. 2007. Human brain activity time-locked to narrative event boundaries. Psychological Science 18, 5 (2007), 449--455.
[15]
Harald G Wallbott. 1998. Bodily expression of emotion. European journal of social psychology 28, 6 (1998), 879--896.
[16]
Daniel Weinland, Remi Ronfard, and Edmond Boyer. 2011. A survey of vision-based methods for action representation, segmentation and recognition. Computer vision and image understanding 115, 2 (2011), 224--241.
[17]
Haris Zacharatos, Christos Gatzoulis, and Yiorgos L Chrysanthou. 2014. Automatic emotion recognition based on body movement analysis: a survey. IEEE computer graphics and applications 34, 6 (2014), 35--45.
[18]
Jeffrey M Zacks, Nicole K Speer, and Jeremy R Reynolds. 2009. Segmentation in reading and film comprehension. Journal of Experimental Psychology: General 138, 2 (2009), 307.
[19]
Jeffrey M Zacks and Khena M Swallow. 2007. Event segmentation. Current Directions in Psychological Science 16, 2 (2007), 80--84.
[20]
Jeffrey M Zacks and Barbara Tversky. 2001. Event structure in perception and conception. Psychological bulletin 127, 1 (2001), 3.

Cited By

View all
  • (2022)Correlated expression of the body, face, and voice during character portrayal in actorsScientific Reports10.1038/s41598-022-12184-712:1Online publication date: 18-May-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MOCO '18: Proceedings of the 5th International Conference on Movement and Computing
June 2018
329 pages
ISBN:9781450365048
DOI:10.1145/3212721
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Event Segmentation Theory
  2. Event Structure perception
  3. Segmentation
  4. prediction

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

MOCO '18

Acceptance Rates

Overall Acceptance Rate 85 of 185 submissions, 46%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2022)Correlated expression of the body, face, and voice during character portrayal in actorsScientific Reports10.1038/s41598-022-12184-712:1Online publication date: 18-May-2022

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media