poster

A New Approach to Parallel Interaction through Co-located and Object-oriented Storytelling

Authors:

Sai-Keung Wong,

Wei-Che ChangAuthors Info & Claims

CSCW '20 Companion: Companion Publication of the 2020 Conference on Computer Supported Cooperative Work and Social Computing

Pages 233 - 238

https://doi.org/10.1145/3406865.3418315

Published: 17 October 2020 Publication History

Abstract

Storytelling which is a productive intimate parent-child interaction activity can promote children's emotional management, social competence, and cognitive ability. Joint media engagement (JME) provides digital interaction and becomes a convenient tool for storytelling. However, the interaction between users via JME can be unnatural and unintuitive because of the drawbacks due to the one-sided human-machine interface, continual attention, and tedious work in story planning for characters. To tackle the drawbacks, we propose a parallel interaction storytelling system that uses co-located story enactment experience and object-oriented characters. Our system enables users to enhance parallel interaction in a virtual collaboration environment for storytelling. They can interactively construct stories and manipulate characters in an intuitive manner. An initial testing of the system shows a popular adaptation for parents and their children.

References

[1]

Louise Phillips. 1999. The Role of Storytelling in Early Literacy Development. Education Resources Information Center.

[2]

Kenneth R. Ginsburg. 2007. The importance of play in promoting healthy child development and maintaining strong parent-child bonds. Pediatrics. 119(1), 182--191.

[3]

Fei Lu, Feng Tian, Yingying Jiang, Xiang Cao, Wencan Luo, Guang Li, Xiaolong Zhang, Guozhong Dai, Hongan Wang. 2011. Shadowstory: creative and collaborative digital storytelling inspired by cultural heritage. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). 1919--1928.

Digital Library

[4]

Nicola Yuill, Alex F. Martin. 2016. Curling Up With a Good E-Book: Mother-Child Shared Story Reading on Screen or Paper Affects Embodied Interaction and Warmth. Frontiers in psychology, 7(1951).

[5]

R. C. Teepe, I. Molenaar, L. Verhoeven. 2017. Technology?enhanced storytelling stimulating parent-child interaction and preschool children's vocabulary knowledge. Journal of Computer Assisted Learning, 33(2), 123--136.

Digital Library

[6]

Alejandro Catala, Mari�t Theune, Hannie Gijlers, and Dirk Heylen. 2017. Storytelling as a Creative Activity in the Classroom. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (C&C '17). 237--242.

Digital Library

[7]

Lori Takeuchi, Reed Stevens. 2011. The new coviewing: designing for learning through joint media engagement. New York: Joan Ganz Cooney Center at Sesame Workshop and LIFE Center.

[8]

Elisa Rubegni, Monica Landoni. 2018. How to design a digital storytelling authoring tool for developing pre-reading and pre-writing skills. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). No. 395. 1--10.

Digital Library

[9]

Anna V. Sosa. 2016. Association of the Type of Toy Used During Play With the Quantity and Quality of Parent-Infant Communication. JAMA Pediatrics, 170(2), 132--137.

[10]

Alexis Hiniker, Bongshin Lee, Julie A. Kientz, Jenny S. Radesky. 2018. Let's Play! Digital and Analog Play between Preschoolers and Parents. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). No. 659.

Digital Library

[11]

Robin, Bernard R. 2008. Digital Storytelling: A Powerful Technology Tool for the 21st Century Classroom. Theory Into Practice, 47(3), 220--228.

[12]

Elisa Rubegni and Monica Landoni. 2015. Supporting creativity in designing story authoring tools. In Proceedings of the 14th International Conference on Interaction Design and Children (IDC '15). 287--290.

Digital Library

[13]

K. Ryokai, J. Cassell. 1999. Computer support for children's collaborative fantasy play and storytelling. In Proceedings of the 1999 conference on Computer support for collaborative learning. 63. International Society of the Learning Sciences.

Digital Library

[14]

Perret, R., Borgers, M.R.S., and Santoro, F.M. 2004. Applying Group Storytelling in Knowledge Management. Springer (LNCS 3198). 34--41.

[15]

Wahju Agung Widjajanto, Michael Lund, and Heidi Schelhowe. 2008. "Wayang Authoring": a web-based authoring tool for visual storytelling for children. In Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia (MoMM '08). 464--467.

Digital Library

[16]

Juan Pablo Hourcade, Benjamin B. Bederson, Allison Druin, and Gustav Tax�n. 2002. KidPad: Collaborative Storytelling for Children. In CHI '02 Extended Abstracts on Human Factors in Computing Systems (CHI EA '02). 500--501.

Digital Library

[17]

Alexander J. Quinn, Benjamin B. Bederson, Elizabeth M. Bonsignore, and Allison Druin. 2009. StoryKit: Designing a Mobile Application for Story Creation by Children and Older Adults. (Technical Report No. HCIL-2009--22), 1--10, Human Computer Interaction Lab, University of Maryland, College Park, MD.

[18]

Gustav Tax�n, Allison Druin, Carina Fast, and Marita Kjellin. 2010. KidStory: A technology design partnership with children. Behaviour & Information Technology. 20(2), 119--125.

[19]

Timo G�ttel. 2011. Reviewing children's collaboration practices in storytelling environments. In Proceedings of the 10th International Conference on Interaction Design and Children (IDC '11). 153--156.

Digital Library

[20]

Laura Benton, Asimina Vasalou, Daniel Gooch, and Rilla Khaled. 2014. Understanding and fostering children's storytelling during game narrative design. In Proceedings of the 2014 conference on Interaction design and children (IDC '14). 301--304.

Digital Library

[21]

Elisa Rubegni, Monica Landoni. 2014. Fiabot!: design and evaluation of a mobile storytelling application for schools. In Proceedings of the 2014 conference on Interaction design and children (IDC '14). 165--174.

Digital Library

[22]

Qiong Peng. 2017. Storytelling Tools in Support of User Experience Design. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). 316--319.

Digital Library

[23]

Nesra Yannier, Ali Israr, Jill Fain Lehman, Roberta L. Klatzky. 2015. FeelSleeve? Haptic Feedback to Enhance Early Reading. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI'15). 1015--1024.

Digital Library

[24]

Nicola Yuill, Alex F. Martin. 2016. Curling Up With a Good E-Book: Mother-Child Shared Story Reading on Screen or Paper Affects Embodied Interaction and Warmth. Frontiers in psychology, 7(1951).

[25]

Seokwoo Song, Seungho Kim, John Kim, Wonjeong Park, Dongsun Yim. 2016. TalkLIME: Mobile System Intervention to Improve Parent-child Interaction for Children with Language Delay. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp'16). 304--315.

Digital Library

[26]

Cory A. Kildare, Wendy Middlemiss. 2017. Impact of parents mobile device use on parent-child interaction: A literature review. Computers in Human Behavior, 75, 579--593.

Digital Library

[27]

Hyein Chang, Daniel S. Shaw, Elizabeth C. Shelleby, Thomas J. Dishion, Melvin N. Wilson. 2017. The Long-Term Effectiveness of the Family Check-up on Peer Preference: Parent-Child Interaction and Child Effortful Control as Sequential Mediators. Journal of Abnormal Child Psychology, 45(4), 705--717.

[28]

R. C. Teepe, I. Molenaar, L. Verhoeven. 2017. Technology?enhanced storytelling stimulating parent-child interaction and preschool children's vocabulary knowledge. Journal of Computer Assisted Learning, 33(2), 123--136.

Digital Library

[29]

Chlo� Bontinck, Petra Warreyn, Mieke Meirsschaut, Herbert Roeyers. 2018. Parent-Child Interaction in Children with Autism Spectrum Disorder and Their Siblings: Choosing a Coding Strategy. Journal of Child and Family Studies, 27(1), 91--102.

[30]

Q. Wu, Victor Cebotari. 2018. Experiences of migration, parent-child interaction, and the life satisfaction of children in Ghana and China. Population, Space and Place.

Cited By

Theofanopoulou NAntle ASlovak P(2024)"They Don't Come With a Handbook": Exploring Design Opportunities for Supporting Parent-Child Interaction around Emotions in the Family ContextProceedings of the ACM on Human-Computer Interaction10.1145/36374098:CSCW1(1-33)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637409
Chen BWong SChang WFan R(2022)LAGH: Towards Asymmetrical Collaborative Bodily Play between 1st and 2nd Person PerspectivesProceedings of the ACM on Human-Computer Interaction10.1145/35555486:CSCW2(1-26)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555548
Martinez JWindleharth TLi QBhattacharya APearce KYip JLee J(2022)Joint Media Engagement in Families Playing Animal Crossing: New Horizons during the COVID-19 PandemicProceedings of the ACM on Human-Computer Interaction10.1145/35129476:CSCW1(1-22)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512947
Show More Cited By

Index Terms

A New Approach to Parallel Interaction through Co-located and Object-oriented Storytelling
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

Towards Object-oriented Storytelling via 1st and 3rd Person Perspectives
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Joint media engagement (JME) provides digital interaction and becomes a convenient tool for collaborative storytelling. However, the person perspectives, reusability, and modifiability of the story contents are rarely discussed; also parents may lack ...
An Approach for Asynchronous Awareness Support in Collaborative Non-Linear Storytelling

Workspace awareness support is mandatory for group support systems. It allows users not only to follow actions of others, but to understand and respond to any changes others make to the workspace. In this paper, we present a novel approach for ...
Hyperstories and social interaction in 2D and 3D edutainment spaces for children
HYPERTEXT '06: Proceedings of the seventeenth conference on Hypertext and hypermedia

This paper presents FaTe2, an edutainment environment for children that combines a variety of paradigms: storytelling, hypertext, games, collaborative learning, and social interaction. FaTe2 provides a web based, multi-user, multi-dimension hyperspace, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '20 Companion: Companion Publication of the 2020 Conference on Computer Supported Cooperative Work and Social Computing

October 2020

559 pages

ISBN:9781450380591

DOI:10.1145/3406865

General Chairs:
Matthew Bietz
University of California, Irvine
,
Andrea Wiggins

Copyright � 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2020

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

Ministry of Science and Technology of the R.O.C.

Conference

CSCW '20

Sponsor:

SIGCHI

CSCW '20: Computer Supported Cooperative Work and Social Computing

October 17 - 21, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
178
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)4

Reflects downloads up to 21 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Theofanopoulou NAntle ASlovak P(2024)"They Don't Come With a Handbook": Exploring Design Opportunities for Supporting Parent-Child Interaction around Emotions in the Family ContextProceedings of the ACM on Human-Computer Interaction10.1145/36374098:CSCW1(1-33)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637409
Chen BWong SChang WFan R(2022)LAGH: Towards Asymmetrical Collaborative Bodily Play between 1st and 2nd Person PerspectivesProceedings of the ACM on Human-Computer Interaction10.1145/35555486:CSCW2(1-26)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555548
Martinez JWindleharth TLi QBhattacharya APearce KYip JLee J(2022)Joint Media Engagement in Families Playing Animal Crossing: New Horizons during the COVID-19 PandemicProceedings of the ACM on Human-Computer Interaction10.1145/35129476:CSCW1(1-22)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512947
Theofanopoulou NSlovak P(2022)Exploring Technology-Mediated Parental Socialisation of Emotion: Leveraging an Embodied, In-situ Intervention for Child Emotion RegulationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502130(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502130
Chen BWong SHuang C(2022)Towards Object-oriented Storytelling via 1st and 3rd Person PerspectivesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519649(1-6)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519649
Ellegaard Christensen AMagnussen MSeindal TRaptis D(2021)Shaping Romance: Mediating Intimacy for Co-located CouplesProceedings of the 33rd Australian Conference on Human-Computer Interaction10.1145/3520495.3520502(86-98)Online publication date: 30-Nov-2021
https://dl.acm.org/doi/10.1145/3520495.3520502

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents