Companion apps for long arc TV series: supporting new viewers in complex storyworlds with tightly synchronized context-sensitive annotations

ABSTRACT

As television merges with digital technology, storytelling is becoming increasingly complex. Use of a second screen has become common, but academic research has focused on social applications and commercial applications have stressed community-building and trivia questions. Our survey of viewers reveals an unmet need for tightly synchronized second screen applications that can help them to enter and keep track of dramatic series with multiple recurring characters and multi-episode story arcs. We employed an iterative design process to create a second screen companion application for the critically acclaimed series Justified that was tightly synchronized, context-sensitive, and character-focused. Our usability testing indicated that use of the companion app enhanced comprehension for first-time viewers of a late season episode, and was especially effective in supporting understanding of character relationships, while also surfacing design considerations for future applications.

References

1. Barkhuus, L. and B. Brown. Unpacking the television: User practices around a changing technology. In ACM Transactions on Computer-Human Interaction (TOCHI) (2009). 16(3): p. 15.
2. Blanco, R., Morales, G.D.F, Silvestri, F. Towards leveraging closed captions for news retrieval. In Proc. WWW 2013 (Companion V olume), pp.135--136.
3. Cesar, P. and K. Chorianopoulos. The evolution of TV systems, content, and users toward interactivity. In Found. Trends Hum.-Comput. Interact (2013). . 2, 4, 373--95
4. Cesar, P., D.C.A. Bulterman, and A.J. Jansen. Usages of the secondary screen in an interactive television environment: control, enrich, share, and transfer television content, in Changing television environments. Springer (2008). p. 168--177
5. Chuang, Y.-L., et al. Use Second Screen t Enhance TV Viewing Experiences, in Cross-Cultural Design. Methods, Practice, and Case Studies. Springer (2013). p. 366--374.
6. Cox, D., Wolford, J., Jensen, C., & Beardsley, D. An evaluation of game controllers and tablets as controllers for interactive tv applications. In Proc. ICMI 2012. (pp. 181--188). ACM (2012).
7. Doughty, M., Rowland, D, Lawson, S. Who is on your sofa?: TV audience communities and second screening social networks. In Proc. EuroiTV 2012. ACM Press (2012).
8. Geerts, D. and D. De Grooff.. Supporting the social uses of television: sociability heuristics for social TV. In proc. CHI 2009, ACM Press (2009).
9. Geisler, G., G. Willard, and C. Ovalle, A crowdsourcing framework for the production and use of film and television data. New Review of Hypermedia and Multimedia, 2011. 17(1): p. 73--97.
10. Harboe, G., et al. Ambient social tv: drawing people into a shared experience, In Proc. CHI 2008, ACM Press (2008).
11. Hess, J., et al. Jumping between devices and services: towards an integrated concept for social tv. In Proc. 2012 EuroITV 2011, ACM Press (2011).
12. Hess, J., et al. Bridging among people, places & devices by integrated, ambient and playful socialmedia approaches. In Proc. EuroITV 2010, ACM Press (2010).
13. Jenkins, H., Transmedia storytelling. Volume (1) (2009). p. 56.
14. Jenkins, H. Convergence culture: Where old and new media collide. NYU press (2006).
15. Jenkins, H., et al. Spreadable media: Creating value and meaning in a networked culture. NYU Press (2012).
16. Lesser, W. How TV Tells Us What Went Before, in The New York Times (2013).
17. Leonard, E. Pronto. HarperCollins (2009).
18. Leonard, . Riding the rap. HarperCollins (2009).
19. Leonard, E. Raylan. Hachette UK (2012).
20. Lochrie, M., Coulton, P. Mobile phones as second screen for TV, enabling inter-audience interaction. In Proc. ACE 2011, Article 73, ACM Press (2011)
21. Mar, R.A. and K. Oatley, The function of fiction is the abstraction and simulation of social experience. Perspectives on psychological science, 2008. 3(3): p. 173--192.
22. Mittell, J., Narrative complexity in contemporary American television. The Velvet Light Trap, 2006. 58(1): p. 29--40.
23. Murray, J., et al. 2012. Story-map: iPad companion for long form TV narratives. In Proc. of Euro ITV 2012, ACM,Press 223--226.
24. Murray, J., Goldenberg, S., et al. StoryLines: an approach to navigating multisequential news and entertainment in a multiscreen framework. In Proc. ACE 2011, ACM Press (2011).
25. Murray, J. Transcending transmedia: emerging story telling structures for the emerging convergence platforms. In Proc. EuroiTV 2012. ACM Press(2012).
26. Murray, J. Hamlet on the Holodeck: The future of narrative in cyberspace. Simon and Schuster (1997).
27. Oatley, K. 2011. Such stuff as dreams: the psychology of fiction. Wiley-Blackwell.
28. Simon, H., E. Comunello, and A. von Wangenheim. Enrichment of Interactive Digital TV using Second Screen. International Journal of Computer Applications, 2013. 64(22): p. 58--64.
29. Simons, N. Television audience research in the age of convergence: challenges and difficulties. In Proceedings of the 9th international interactive conference on Interactive television (pp. 101--104). ACM Press (2011).
30. Stark, C. What's the ideal length for a YouTube video? Stark Insider (2013).
31. Tsekleves, E., et al. Investigating media use and the television user experience in the home. In Entertainment computing, 2011. 2(3): p. 151--161
32. Vance, A. 2013. Netflix, Reed Hastings Survive Missteps to Join Silicon Valley's Elite, in Bloomberg Businessweek (2013).
33. Winkle, P.V. Lead Us Not Into Temptation: The Second Screen Addiction, in Oz Magazine. Oz Publishing, Inc (2013).
34. Yost, G. Justified, FX Network (2010-now)
35. Yost, G. Culver City Interview with J. Murray, Feb 18,
36. Global Internet Phenomena. Sandvine Report.
37. HBO GO. Game of Thrones Interactive Experience (2013).
38. Leverage app for iOS and Android. Turner Broadcasting(2012). http://www.tntdrama.com/series/leverage/display/cont entId=244273

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)