LifeSeeker: Interactive Lifelog Search Engine at LSC 2019

ABSTRACT

In this paper we present a first version of the LifeSeeker interactive lifelog retrieval engine that is under development at Dublin City University. This retrieval engine has been designed as a platform onto which future lifelog annotation and retrieval engines will be built. The first implementation of LifeSeeker has been designed for the LSC'19 comparative benchmarking challenge and it takes the form of a faceted search and browsing interface with the addition of query expansion to help solve the lexical-gap between novice users and the concept annotation tools employed for annotating the collection.

References

1. Gabriel De Oliveira-Barra, X Giró-i Nieto, Alejandro Cartas-Ayala, and Petia Radeva. 2015. LEMoRe: A Lifelog Engine for Moments Retrieval at the NTCIR-Lifelog LSAT Task.The 12th NTCIR Conference, Evaluation of Information Access Technologies(2015), 0--5.
2. Aiden R. Doherty, Katalin Pauly-Takacs, Niamh Caprani, Cathal Gurrin, Chris J. a. Moulin, Noel E. O'Connor, and Alan F. Smeaton. 2012. Experiences of Aiding Autobiographical Memory Using the SenseCam. Human-Computer Interaction 27, 1--2 (2012), 151--174.
3. Aaron Duane, Cathal Gurrin, and Wolfgang Hürst. 2018. Virtual Reality Lifelog Explorer: Lifelog Search Challenge at ACM ICMR 2018. In Proceedings of the 2018ACM Workshop on The Lifelog Search Challenge (LSC '18). ACM, New York, NY,USA, 20--23.
4. Roger Gemmell, Jim; Bell, Gordon; Lueder. 2006. My lifebits: a personal database for everything. Commun. ACM 49, 1 (2006), 88--95.
5. Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, and Rami Albatal.2016. Overview of NTCIR-12 Lifelog Task. (2016), 354--360. http://eprints.gla.ac.uk/131460/ The authors acknowledge the financial support of Science Foundation Ireland (SFI) under grant number SFI/12/RC/2289 and the input of theDCU ethics committee and the risk & compliance officer. We acknowledge financial support by the European Science Foundation via its Research Network Programme? Evaluating Information Access Systems?.
6. Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Bernd Munzer, Rami Albatal, Frank Hopfgartner, Liting Zhou, and Duc-Tien Dang-Nguyen. 2019. A Test Collection for Interactive Lifelog Retrieval. In MultiMedia Modeling, Ioannis Kompatsiaris, Benoit Huet, Vasileios Mezaris, Cathal Gurrin, Wen-Huang Cheng, and Stefanos Vrochidis (Eds.). Springer International Publishing, 312--324.
7. Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Liting Zhou, Aaron Duane, Andreas Leibetseder, Michael Riegler, Luca Piras, Minh-Triet Tran, Jakub Loko?, and Wolfgang Hürst. 2019. Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge ( LSC2018 ). ITE Transactions on Media Technology and Applications7, 2 (2019), 46--59.
8. Steve Hodges, Lyndsay Williams, Emma Berry, James Srinivasan, Gavin Smyth,Narinder Kapur, and Ken Woodberry. 2006. SenseCam: A Retrospective Memory Aid. In Proceedings of the 8th International Conference of Ubiquitous Computing(UbiComp 2006)(proceedings of the 8th international conference of ubiquitous computing (ubicomp 2006) ed.). Springer Verlag, 177--193. https://www.microsoft.com/en-us/research/publication/sensecam-a-retrospective-memory-aid/
9. Diane Kelly. 2009. Methods for Evaluating Interactive Information Retrieval Systems with Users.Foundations and TrendsÂ? in Information Retrieval3, 1--2(2009), 1--224.
10. Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. In HCI and Usability for Education and Work, Andreas Holzinger (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg,63--76.
11. Tsung-Yi Lin, Michael Maire, Serge J. Belongie, Lubomir D. Bourdev, Ross B. Girshick, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. CoRRabs/1405.0312(2014). arXiv:1405.0312 http://arxiv.org/abs/1405.0312
12. Jakub Lokoc, Gregor Kovalcík, Bernd Münzer, Klaus Schöffmann, Werner Bailer,Ralph Gasser, Stefanos Vrochidis, Phuong Anh Nguyen, Sitapa Rujikietgumjorn,and Kai Uwe Barthel. 2019. Interactive Search or Sequential Browsing? A Detailed Analysis of the Video Browser Showdown 2018. ACM Trans. Multimedia Comput. Commun. Appl.15, 1, Article 29 (Feb. 2019), 18 pages.
13. Jakub Lokoc, Tomás Soucek, and Gregor Kovalcik. 2018. Using an Interactive Video Retrieval Tool for LifeLog Data. In Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge (LSC '18). ACM, New York, NY, USA, 15--19.
14. David G. Lowe. 2004. Distinctive Image Features from Scale-Invariant Keypoints. Int. J. Comput. Vision 60, 2 (Nov. 2004), 91--110.
15. Bernd Münzer, Andreas Leibetseder, Sabrina Kletz, Manfred Jürgen Primus, and Klaus Schoeffmann. 2018. lifeXplore at the Lifelog Search Challenge 2018. In Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge (LSC '18). ACM, New York, NY, USA, 3--8.
16. Van-Tu Ninh, Tu-Khiem Le, Liting Zhou, Graham Healy, Minh-Triet Tran, Duc-Tien Dang-Nguyen, Sinead Smyth, and Cathal Gurrin. 2019. A Baseline Interactive Retrieval Engine for the NTICR-14 Lifelog-3 Semantic Access Task. In The Fourteenth NTCIR conference (NTCIR-14).
17. S. E. Robertson and K. Sparck Jones. 1997. Simple, Proven Approaches to Text Retrieval. Technical Report.
18. Bharat Singh and Larry S Davis. 2018. An analysis of scale in variance in object detection-snip. CVPR(2018).
19. Bharat Singh, Mahyar Najibi, and Larry S Davis. 2018. SNIPER: Efficient Multi-Scale Training. NIPS(2018).
20. Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba. 2017. Places: A 10 million Image Database for Scene Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence(2017).
21. Guido Zuccon, Bevan Koopman, Peter Bruza, and Leif Azzopardi. 2015. Integrating and Evaluating Neural Word Embeddings in Information Retrieval. In Proceedings of the 20th Australasian Document Computing Symposium (ADCS '15). ACM,New York, NY, USA, Article 12, 8 pages.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interactive systems and tools