The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Multimodal Data Integration and User Interaction for Avatar Simulation in Augmented Reality
|
|
Author(s): Anchen Sun (University of Miami, USA), Yudong Tao (University of Miami, USA), Mei-Ling Shyu (University of Miami, USA), Angela Blizzard (University of Miami, USA), William Andrew Rothenberg (University of Miami, USA), Dainelys Garcia (University of Miami, USA)and Jason F. Jent (University of Miami, USA)
Copyright: 2022
Volume: 13
Issue: 1
Pages: 19
Source title:
International Journal of Multimedia Data Engineering and Management (IJMDEM)
Editor(s)-in-Chief: Chengcui Zhang (University of Alabama at Birmingham, USA)and Shu-Ching Chen (University of Missouri-Kansas City, United States)
DOI: 10.4018/IJMDEM.304391
Purchase
|
Abstract
Augmented Reality (AR) allows users to interact with the virtual world in the real-world environment. This paper proposes a child avatar simulation framework using multimodal data integration and user interaction in the AR environment. This framework generates the child avatar that can interact with the user and respond to his/her behaviors and consists of three subsystems: (1) the avatar interaction system scrutinizes user behaviors based on the user data, (2) the avatar action control system generates naturalistic avatar activities (actions and voices) according to the avatar internal status, and (3) the avatar display system renders the avatar through the AR interface. In addition, a child tantrum management training application has been built based on the proposed framework. And a light machine learning model has been integrated to enable efficient and effective speech emotion recognition. A sufficiently realistic child tantrum management training based on the evaluation of clinical child psychologists is enabled, which helps users get familiar with child tantrum management.
Related Content
|
Yasasi Abeysinghe, Bhanuka Mahanama, Gavindya Jayawardena, Yasith Jayawardana, Mohan Sunkara, Andrew T. Duchowski, Vikas Ashok, Sampath Jayarathna.
© 2024.
20 pages.
|
|
Chengxuan Huang, Evan Brock, Dalei Wu, Yu Liang.
© 2023.
23 pages.
|
|
Duleep Rathgamage Don, Jonathan Boardman, Sudhashree Sayenju, Ramazan Aygun, Yifan Zhang, Bill Franks, Sereres Johnston, George Lee, Dan Sullivan, Girish Modgil.
© 2023.
17 pages.
|
|
Wei-An Teng, Su-Ling Yeh, Homer H. Chen.
© 2023.
17 pages.
|
|
Hemanth Gudaparthi, Prudhviraj Naidu, Nan Niu.
© 2022.
20 pages.
|
|
Anchen Sun, Yudong Tao, Mei-Ling Shyu, Angela Blizzard, William Andrew Rothenberg, Dainelys Garcia, Jason F. Jent.
© 2022.
19 pages.
|
|
Suvojit Acharjee, Sheli Sinha Chaudhuri.
© 2022.
16 pages.
|
|
|