Wearing another's personality: a human-surrogate system with a telepresence face

ABSTRACT

ChameleonMask is a telepresence system that displays a remote user's face on another user's face. Whereas most telepresence systems are designed to provide the remote user with an existence via a teleoperated robot, the system uses a real human as a surrogate for the remote user. This is accomplished by the surrogate user wearing a mask-shaped display that shows the remote user's live face, and a voice channel transmitting the remote user's voice. The surrogate user mimics the remote user by following the remote user's directions. In initial experiments conducted, the surrogate tended to be regarded as the actual person (i.e., the remote user). We implemented applications the remote user gives the surrogate directions visually. We conducted user studies to determine how the remote user felt about giving directions to the surrogate and how the surrogate felt to be the body of the director. In the studies conducted, the director had the confidence to go outside with ChameleonMask and the surrogate tended to fulfill the director's requests and felt positive about being the surrogate.

References

1. Adalgeirsson, S. O., and Breazeal, C. Mebot: A robotic platform for socially embodied presence. Proc. of HRI '10, 15--22.
2. Bermano, A., Brüschweiler, P., Grundhöfer, A., Iwai, D., Bickel, B., and Gross, M. Augmenting physical avatars using projector-based illumination. ACM Trans. Graph. 32 '13, 189:1--189:10.
3. Kana, M., and Jun, R. ChameleonMask: Embodied Physical and Social Telepresence using human surrogates. Proc. of CHI '15 EA.
4. Goldberg, K., Song, D., Khor, Y., Pescovitz, D., Levandowski, A., Himmelstein, J., Shih, J., Ho, A., Paulos, E., Donath, J., Berkeley, U., and Mit, J. D. Collaborative online teleoperation with spatial dynamic voting and a human "tele-actor". Proc. of ICRA '02, 1179--1184.
5. Hayamizu, A., Imai, M., Nakamura, K., and Nakadai, K. Volume adaptation and visualization by modeling the volume level in noisy environments for telepresence system. Proc of HAI '14, 67--74.
6. Kasahara, S., and Rekimoto, J. Jackin: Integrating first-person view with out-of-body vision generation for human-human augmentation. Proc. of AH '14, 46:1--46:8.
7. Kashiwabara, T., Osawa, H., Shinozawa, K., and Imai, M. Teroos: A wearable avatar to enhance joint activities. Proceedings of CHI '12, 2001--2004.
8. Koike, H., Nishikawa, W., and Fukuchi, K. Transparent 2-d markers on an lcd tabletop system. Proc. of CHI '09, 163--172.
9. Lee, M. K., and Takayama, L. "Now, I have a body": Uses and social norms for mobile remote presence in the workplace. Proc. of CHI '11, 33--42.
10. Misawa, K., Ishiguro, Y., and Rekimoto, J. Livemask: A telepresence surrogate system with a face-shaped screen for supporting nonverbal communication. Proc. of AVI '12, 394--397.
11. Morishima, S., Yotsukura, T., Binsted, K., Nielsen, F., and Pinhanez, C. Hyper mask projecting a talking head onto a real object. Proc. of MMM '00, 403--412.
12. Lincoln, P., Welch, G., Nashel, A., Ilie, A., and Fuchs, H. Animatronic shader lamps avatars. Virtual Reality'11, 15(2-3)225--238.
13. Yang, R., and Zhang, Z Eye Gaze Correction with Stereovision for Video-Teleconferencing. TPAMI'04, 26(7)956--960.
14. Kuster, C., Popa, T., Bazin, J-C., Gotsman, C., and Gross, M. Gaze Correction for Home Video Conferencing. Trans. Graph'12, 31(6)174:1--174:6.
15. Kjeldskov, J., Smedegard, K. Y., Nielsen, S. T., Skov, B. M., and PaayLincoln, J. EyeGaze: Enabling Eye Contact over Video. Proc. AVI'14, 15(2--3)225--238.
16. Nakanishi, H., Kato, K., and Ishiguro, H. Zoom cameras and movable displays enhance social telepresence. Proc. of CHI '11, 63--72.
17. Rae, I., Mutlu, B., and Takayama, L. Bodies in motion: Mobility, presence, and task awareness in telepresence. Proc. of CHI '14, 2153--2162.
18. Rae, I., Takayama, L., and Mutlu, B. The influence of height in robot-mediated communication. Proc. of HRI '13, 1--8.
19. Jennifer, G. S., Alan, D., Simon, L., and Alice, B. Understanding interaction in ubiquitous guerrilla performances in playful arenas. A framework for understanding and designing telepresence. '05, 3--17.
20. Toney, A., Mulley, B., Thomas, B. H., and Piekarski, W. Minimal social weight user interactions for wearable computers in business suits. Proc. of ISWC. '02, 57--64.
21. Sakamoto, D., Kanda, T., Ono, T., Ishiguro, H., and Hagita, N. Android as a telecommunication medium with a human-like presence. Proc. of HRI '07, 193--200.
22. Tadakuma, R., Asahara, Y., Kajimoto, H., Kawakami, N., and Tachi, S. Development of anthropomorphic multi-d.o.f. master-slave arm for mutual telexistence. IEEE Trans. on Graphics 11 '05, 626--636.
23. Willis, K., Brockmeyer, E., Hudson, S., and Poupyrev, I. Printed optics: 3d printing of embedded optical elements for interactive devices. Proc. of UIST '12, 589--598.

Index Terms

• Human-centered computing

  • Collaborative and social computing

    • Collaborative and social computing theory, concepts and paradigms

      • Computer supported cooperative work

• Social and professional topics

  • Professional topics

    • Computing and business

      • Computer supported cooperative work