Bounds of Neglect Benevolence in Input Timing for Human Interaction with Robotic Swarms

ABSTRACT

Robotic swarms are distributed systems whose members interact via local control laws to achieve a variety of behaviors, such as flocking. In many practical applications, human operators may need to change the current behavior of a swarm from the goal that the swarm was going towards into a new goal due to dynamic changes in mission objectives. There are two related but distinct capabilities needed to supervise a robotic swarm. The first is comprehension of the swarm's state and the second is prediction of the effects of human inputs on the swarm's behavior. Both of them are very challenging. Prior work in the literature has shown that inserting the human input as soon as possible to divert the swarm from its original goal towards the new goal does not always result in optimal performance (measured by some criterion such as the total time required by the swarm to reach the second goal). This phenomenon has been called Neglect Benevolence, conveying the idea that in many cases it is preferable to neglect the swarm for some time before inserting human input. In this paper, we study how humans can develop an understanding of swarm dynamics so they can predict the effects of the timing of their input on the state and performance of the swarm. We developed the swarm configuration shape-changing Neglect Benevolence Task as a Human Swarm Interaction (HSI) reference task allowing comparison between human and optimal input timing performance in control of swarms. Our results show that humans can learn to approximate optimal timing and that displays which make consensus variables perceptually accessible can enhance performance.

References

1. T. Balch and R. C. Arkin. Behavior-based formation control for multirobot teams. Robotics and Automation, IEEE Transactions on, 14(6):926--939, 1998.
2. B. I. Bertenthal and J. Pinto. Global processing of biological motions. Psychological science, 5(4):221--225, 1994.
3. D. S. Brown, S. C. Kerman, and M. A. Goodrich. Human-swarm interactions based on managing attractors. In Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction, pages 90--97. ACM, 2014.
4. D. J. Bruemmer, D. D. Dudenhoeffer, M. D. McKay, and M. O. Anderson. A robotic swarm for spill finding and perimeter formation. Technical report, DTIC Document, 2002.
5. A. Buchner, J. Funke, and D. C. Berry. Negative correlations between control performance and verbalizable knowledge: Indicators for implicit learning in process control tasks? The Quarterly Journal of Experimental Psychology, 48(1):166--187, 1995.
6. F. Bullo, J. Cortés, and S. Martinez. Distributed control of robotic networks: a mathematical approach to motion coordination algorithms. Princeton University Press, 2009.
7. H. Choset. Coverage for robotics-a survey of recent results. Annals of mathematics and artificial intelligence, 31(1--4):113--126, 2001.
8. G. Coppin and F. Legras. Autonomy spectrum and performance perception issues in swarm supervisory control. Proceedings of the IEEE, 100(3):590--603, 2012.
9. I. D. Couzin, J. Krause, R. James, G. D. Ruxton, and N. R. Franks. Collective memory and spatial sorting in animal groups. Journal of theoretical biology, 218(1):1--11, 2002.
10. L. J. Croner and T. D. Albright. Image segmentation enhances discrimination of motion in visual noise. Vision research, 37(11):1415--1427, 1997.
11. J. E. Cutting, C. Moore, and R. Morrison. Masking the motions of human gait. Perception & Psychophysics, 44(4):339--347, 1988.
12. J.-P. de la Croix and M. Egerstedt. Controllability characterizations of leader-based swarm interactions. In AAAI Fall Symposium: Human Control of Bioinspired Swarms, 2012.
13. F. Ducatelle, G. A. Di Caro, and L. M. Gambardella. Cooperative self-organization in a heterogeneous swarm robotic system. In Proceedings of the 12th annual conference on Genetic and evolutionary computation, pages 87--94. ACM, 2010.
14. M. Egerstedt and X. Hu. Formation constrained multi-agent control. Robotics and Automation, IEEE Transactions on, 17(6):947--951, Dec 2001.
15. M.-A. Fields, E. Haas, S. Hill, C. Stachowiak, and L. Barnes. Effective robot team control methodologies for battlefield applications. In Intelligent Robots and Systems, 2009. IROS 2009. IEEE/RSJ International Conference on, pages 5862--5867. IEEE, 2009.
16. V. Gazi and K. M. Passino. Stability analysis of social foraging swarms. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 34(1):539--557, 2004.
17. E. Grossman and E. Cooke. Manual control of slow-response systems. Ergonomics: Major Writings, page 281, 2005.
18. G. Johansson. Visual perception of biological motion and a model for its analysis. Perception & psychophysics, 14(2):201--211, 1973.
19. Z. Kira and M. A. Potter. Exerting human control over decentralized robot swarms. In Autonomous Robots and Agents, 2009. ICARA 2009. 4th International Conference on, pages 566--571. IEEE, 2009.
20. G. Knoblich and R. Flach. Predicting the effects of actions: Interactions of perception and action. Psychological Science, 12(6):467--472, 2001.
21. A. Kolling, S. Nunnally, and M. Lewis. Towards human control of robot swarms. In Proceedings of the seventh annual ACM/IEEE international conference on human-robot interaction, pages 89--96. ACM, 2012.
22. B. R. Levinthal and S. L. Franconeri. Common-fate grouping as feature selection. Psychological science, page 0956797611418346, 2011.
23. S. Mau and J. M. Dolan. Scheduling to minimize downtime in human-multirobot supervisory control. 2006.
24. J. McLurkin, J. Smith, J. Frankel, D. Sotkowitz, D. Blau, and B. Schmidt. Speaking swarmish: Human-robot interface design for large swarms of autonomous mobile robots. In AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before, pages 72--75, 2006.
25. P. Mitchell, M. Cummings, and T. Sheridan. Management of multiple dynamic human supervisory control tasks. In 10th International Command and Control Research and Technology Symposium, 2005.
26. N. Moray, P. Lootsteen, and J. Pajak. Acquisition of process control skills. Systems, Man and Cybernetics, IEEE Transactions on, 16(4):497--504, 1986.
27. N. M. Morris and W. B. Rouse. The effects of type of knowledge upon human problem solving in a process control task. Systems, Man and Cybernetics, IEEE Transactions on, (6):698--707, 1985.
28. S. Nagavalli, L. Luo, N. Chakraborty, and K. Sycara. Neglect benevolence in human control of robotic swarms. In 2014 IEEE International Conference on Robotics and Automation (ICRA), pages 6047--6053, May 2014.
29. D. R. Olsen and M. A. Goodrich. Metrics for evaluating human-robot interactions. In Proceedings of PERMIS, volume 2003, page 4, 2003.
30. W. Ren, R. W. Beard, and E. M. Atkins. A survey of consensus problems in multi-agent coordination. In American Control Conference, 2005. Proceedings of the 2005, pages 1859--1864. IEEE, 2005.
31. C. W. Reynolds. Flocks, herds and schools: A distributed behavioral model. ACM SIGGRAPH Computer Graphics, 21(4):25--34, 1987.
32. S. Runeson and G. Frykholm. Visual perception of lifted weight. Journal of Experimental Psychology: Human Perception and Performance, 7(4):733, 1981.
33. W. M. Spears and D. F. Spears. Physicomimetics: Physics-based swarm intelligence. Springer, 2012.
34. A. Steinfeld, T. Fong, D. Kaber, M. Lewis, J. Scholtz, A. Schultz, and M. Goodrich. Common metrics for human-robot interaction. In Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, pages 33--40. ACM, 2006.
35. F. Stürzel and L. Spillmann. Perceptual limits of common fate. Vision research, 44(13):1565--1573, 2004.
36. M. Turpin, N. Michael, and V. Kumar. Decentralized formation control with variable shapes for aerial robots. In Robotics and Automation (ICRA), 2012 IEEE International Conference on, pages 23--30. IEEE, 2012.
37. W. R. Uttal, L. Spillmann, F. Stürzel, and A. B. Sekuler. Motion and shape in common fate. Vision Research, 40(3):301--310, 2000.
38. P. Walker, S. Nunnally, M. Lewis, A. Kolling, N. Chakraborty, and K. Sycara. Neglect benevolence in human control of swarms in the presence of latency. In Systems, Man, and Cybernetics (SMC), 2012 IEEE International Conference on, pages 3009--3014. IEEE, 2012.
39. S. N. Watamaniuk. Ideal observer for discrimination of the global direction of dynamic random-dot stimuli. JOSA A, 10(1):16--28, 1993.
40. S. N. Watamaniuk, S. P. McKee, and N. M. Grzywacz. Detecting a trajectory embedded in random-direction motion noise. Vision research, 35(1):65--77, 1995.

Index Terms

• Computer systems organization

  • Embedded and cyber-physical systems

    • Robotics

• Computing methodologies

  • Artificial intelligence

    • Control methods

      • Robotic planning

    • Distributed artificial intelligence

      • Multi-agent systems

    • Planning and scheduling

      • Robotic planning

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods