research-article

World's first wearable humanoid robot that augments our emotions

Authors:

Dzmitry Tsetserukou,

Alena NeviarouskayaAuthors Info & Claims

AH '10: Proceedings of the 1st Augmented Human International Conference

Article No.: 8, Pages 1 - 10

https://doi.org/10.1145/1785455.1785463

Published: 02 April 2010 Publication History

Abstract

In the paper we are proposing a conceptually novel approach to reinforcing (intensifying) own feelings and reproducing (simulating) the emotions felt by the partner during online communication through wearable humanoid robot. The core component, Affect Analysis Model, automatically recognizes nine emotions from text. The detected emotion is stimulated by innovative haptic devices integrated into the robot. The implemented system can considerably enhance the emotionally immersive experience of real-time messaging. Users can not only exchange messages but also emotionally and physically feel the presence of the communication partner (e.g., family member, friend, or beloved person).

References

[1]

Anderson, C. A. 1989. Temperature and aggression: ubiquitous effects of heat on occurrence of human violence. Psychological Bulletin 106, 1, 74--96.

[2]

Anttonen, J., and Surakka, V. 2005. Emotions and heart rate while sitting on a chair. In Proceedings of the ACM Conference on Human Factors in Computing Systems (Portland, USA, April 01--07, 2005). CHI '05. ACM Press, New York, 491--499.

Digital Library

[3]

Bickley, L. S. 2008. Bates' Guide to Physical Examination and History Taking. Philadelphia: Lippincott Williams & Wilkins.

[4]

Chang, A., O'Modhrain, S., Jacob, R., Gunther, E., and Ishii, H. 2002. ComTouch: design of a vibrotactile communication device. In Proceedings of the ACM Designing Interactive Systems Conference (London, UK, June 25--28, 2002). DIS '02. ACM Press, New York, 312--320.

Digital Library

[5]

Damasio, A. 2000. The feeling of what happens: body, emotion and the making of consciousness. London: Vintage.

[6]

Decaria, M. D., Proctor, S., and Malloy, T. E. 1974. The effect of false heart rate feedback on self reports of anxiety and on actual heart rate. Behavior research & Therapy, 12, 251--253.

[7]

DiSalvo, C., Gemperle, F., Forlizzi, J., and Montgomery, E. 2003. The Hug: an exploration of robotic form for intimate communication. In Proceedings of the IEEE Workshop on Robot and Human Interactive Communication (Millbrae, USA, Oct. 31 - Nov. 2, 2003). RO-MAN '03, IEEE Press, New York, 403--408.

[8]

Foot H. C., and Chapman, A. J. 1976. The social responsiveness of young children in humorous situation. In Chapman, A. J. & Foot, H. C. (Eds.), Humour and Laugher: Theory, research, and applications. London: Wiley, 187--214.

[9]

Haans, A., and Ijsselsteijn, W. I. 2006. Mediated social touch: a review of current research and future directions. Virtual Reality, 9, 149--159.

Digital Library

[10]

Haans, A., Nood C., Ijsselsteijn, W. A. 2007. Investigating response similarities between real and mediated social touch: a first test. In Proceedings of the ACM Conference on Human Factors in Computing Systems (San Jose, USA, Apr. 28 - May 3, 2007). CHI '07. ACM Press, New York, ACM Press, 2405--2410.

Digital Library

[11]

Harris, C. R., and Christenfeld, N. 1999. Can a machine tickle? Psychonomic Bulletin & Review 6, 3, 504--510.

[12]

Hug Shirt. CuteCircuit Company. http://www.cutecircuit.com

[13]

James, W. 1884. What is an Emotion? Mind, 9, 188--205.

[14]

Kandel, E. R., Schwartz, J. H., and Jessel, T. M. 2000. Principles of Neural Science. New York: McGraw-Hill.

[15]

Keinonen T. and Hemanus J. Mobile emotional notification application. 2005. Nokia Co. US Patent No. 6 959 207.

[16]

Lecuyer, A., Coquillart, S., Kheddar, A., Richard, P., and Coiffet, P. 2000. Pseudo-haptic feedback: Can isometric input devices simulate force feedback? In Proceedings of the IEEE Virtual Reality (New Prunswick, USA, March 18--22, 2000). VR '00. IEEE Press, New York, 403--408.

Digital Library

[17]

LeDoux, J. E. 1996. The emotional brain. New York: Symon & Shuster.

[18]

Mathew, D. 2005. vSmileys: imagine emotions through vibration patterns. In Proceedings Alternative Access: Feeling and Games.

[19]

Mueller F. F., Vetere F., Gibbs M. R., Kjeldskov J., Pedell S., Howard S. 2005. Hug over a distance. In Proceedings of the ACM Conference on Human Factors in Computing Systems 2005 (Portland, USA, April 01--07, 2005). CHI '05. ACM Press, New York, 673--1676.

Digital Library

[20]

Neviarouskaya, H. Prendinger, and M. Ishizuka. 2009. Compositionality principle in recognition of fine-grained emotions from text. In Proceedings of the International AAAI Conference on Weblogs and Social Media (San Jose, USA, May 17--20, 2009). ICWSM 2009. AAAI Press, Menlo Park, 278--281.

[21]

Noe, A. 2004. Action and Perception. Cambridge: MIT Press.

[22]

Norman, D. A. 2004. Emotional design. Why we love (or hate) everyday things. New York: Basic Book.

[23]

Optic Fiber Tactile Sensor Kinotex. Nitta Corporation. http://www.nitta.co.jp/english/product/mechasen/sensor/kinotex_top.html

[24]

Rovers, A. F., and Van Essen H. A. 2004. HIM: a framework for haptic Instant Messaging. In Proceedings of the ACM Conference on Human Factors in Computing Systems 2004 (Vienna, Austria, April 24--29, 2004). CHI '04, ACM Press, New York, 1313--1316.

Digital Library

[25]

Sato, Y., Sato, K., Sato, M., Fukushima, S., Okano, Y., Matsuo, K., Ooshima, S., Kojima, Y., Matsue, R., Nakata, S., Hashimoto, Y., Kajimoto, H. 2008. Ants in the pants -- ticklish tactile display using rotating brushes. In Proceedings of the International Conference on Instrumentation, Control and Information Technology (Tokyo, Japan, August 20--22, 2008). SICE '08, 461--466.

[26]

Shin, H., Lee, J., Park, J., Kim, Y., Oh, H., and Lee, T. 2007. A tactile emotional interface for Instant Messenger chat. In Proceedings of the International Conference on Human-Computer Interaction (Beijing, China, July 22--27, 2007). HCII '07. Springer Press, Heidelberg, 166--175.

Digital Library

[27]

Teh J. K. S., Cheok A. D., Peiris R. L., Choi Y., Thuong V., and Lai S. Haggy pajama: a mobile parent and child hugging communication system. 2008. In Proceedings of the International Conference on Interaction Design and Children (Chicago, USA, June 11--13, 2008). IDC 2008. ACM Press, New York, 250--257.

Digital Library

[28]

Wallbott, H. G., and Scherer, K. R. 1988. How universal and specific is emotional experience? Evidence from 27 countries on five continents. In Scherer, K. R. (Eds.), Facets of Emotion: Recent Research. Hillsdale (N.J.): Lawrence Erlbaum Inc., 31--56.

[29]

Zajonc, R. B., Murphy, S. T., and Inglehart, M. 1989. Feeling and facial efference: implication of the vascular theory of emotion. Psychological review, 96, 395--416.

Cited By

Sun YEffati MNaguib HNejat G(2022)SoftSAR: The New Softer Side of Socially Assistive Robots—Soft Robotics with Social Human–Robot Interaction SkillsSensors10.3390/s2301043223:1(432)Online publication date: 30-Dec-2022
https://doi.org/10.3390/s23010432
Elvitigala DBoldu RNanayakkara SMatthies D(2022)TickleFoot: Design, Development and Evaluation of a Novel Foot-Tickling Mechanism That Can Evoke LaughterACM Transactions on Computer-Human Interaction10.1145/349049629:3(1-23)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3490496
Li HKhan AHurtig KJarusriboonchai PHäkkilä JKaltenbrunner MMurer MWolf KOakley I(2021)Flexi Card Game: A Design Toolkit for Unconventional Communication Systems for Long-Distance RelationshipsProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440650(1-16)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440650
Show More Cited By

Recommendations

Innovative real-time communication system with rich emotional and haptic channels
EuroHaptics'10: Proceedings of the 2010 international conference on Haptics: generating and perceiving tangible sensations, Part I

The paper focuses on a novel system iFeel_IM! that integrates 3D virtual world Second Life, intelligent component for automatic emotion recognition from text messages, and innovative affective haptic interfaces providing additional nonverbal ...
Innovative Real-Time Communication System with Rich Emotional and Haptic Channels
Proceedings, Part I, of the International Conference on Haptics: Generating and Perceiving Tangible Sensations - Volume 6191

The paper focuses on a novel system iFeel_IM! that integrates 3D virtual world Second Life, intelligent component for automatic emotion recognition from text messages, and innovative affective haptic interfaces providing additional nonverbal ...
iFeel_IM: innovative real-time communication system with rich emotional and haptic channels
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

The paper focuses on a novel system iFeel_IM! that integrates 3D virtual world, intelligent component for automatic emotion recognition from text, and innovative affective haptic interfaces providing additional nonverbal communication channels through ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AH '10: Proceedings of the 1st Augmented Human International Conference

April 2010

175 pages

ISBN:9781605588254

DOI:10.1145/1785455

General Chairs:
Hideo Saito
Keio University, Japan
,
Jean-Marc Seigneur
University of Geneva, Switzerland
,
Program Chairs:
Guillaume Moreau
Ecole Centrale de Nantes, France
,
Pranav Mistry
MIT Media Lab

Copyright � 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AH '10

AH '10: 2010 Augmented Human International Conference

April 2 - 3, 2010

Meg�ve, France

Acceptance Rates

AH '10 Paper Acceptance Rate 25 of 46 submissions, 54%;

Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
741
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sun YEffati MNaguib HNejat G(2022)SoftSAR: The New Softer Side of Socially Assistive Robots—Soft Robotics with Social Human–Robot Interaction SkillsSensors10.3390/s2301043223:1(432)Online publication date: 30-Dec-2022
https://doi.org/10.3390/s23010432
Elvitigala DBoldu RNanayakkara SMatthies D(2022)TickleFoot: Design, Development and Evaluation of a Novel Foot-Tickling Mechanism That Can Evoke LaughterACM Transactions on Computer-Human Interaction10.1145/349049629:3(1-23)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3490496
Li HKhan AHurtig KJarusriboonchai PHäkkilä JKaltenbrunner MMurer MWolf KOakley I(2021)Flexi Card Game: A Design Toolkit for Unconventional Communication Systems for Long-Distance RelationshipsProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440650(1-16)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440650
Misztal SCarbonell GZander LSchild J(2020)Jumphair: Improving Jumping Performance in First-Person Video Games Through Visual AssistanceProceedings of the 15th International Conference on the Foundations of Digital Games10.1145/3402942.3403020(1-12)Online publication date: 15-Sep-2020
https://dl.acm.org/doi/10.1145/3402942.3403020
Li H(2019)Beyond the ScreenInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.201910010311:4(31-39)Online publication date: Oct-2019
https://doi.org/10.4018/IJMHCI.2019100103
Endo SFujinami K(2018)Realizing Loose Communication with Tangible Avatar to Facilitate Recipient’s ImaginationInformation10.3390/info90200329:2(32)Online publication date: 1-Feb-2018
https://doi.org/10.3390/info9020032
Li HHäkkilä JVäänänen KBailie LOliver N(2018)Review of unconventional user interfaces for emotional communication between long-distance partnersProceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3229434.3229467(1-10)Online publication date: 3-Sep-2018
https://dl.acm.org/doi/10.1145/3229434.3229467
Hassib MPfeiffer MSchneegass SRohs MAlt FMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Emotion ActuatorProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025953(6133-6146)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025953
Fortin PCooperstock J(2017)Laughter and Tickles: Toward Novel Approaches for Emotion and Behavior ElicitationIEEE Transactions on Affective Computing10.1109/TAFFC.2017.27574918:4(508-521)Online publication date: 1-Oct-2017
https://doi.org/10.1109/TAFFC.2017.2757491
Morrison ALeegaard JManresa-Yee CJensen WKnoche H(2017)Interactive Furniture: Bi-directional Interaction with a Vibrotactile Wearable Vest in an Urban SpaceRecent Advances in Technologies for Inclusive Well-Being10.1007/978-3-319-49879-9_10(183-220)Online publication date: 19-Feb-2017
https://doi.org/10.1007/978-3-319-49879-9_10
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents