Current state and future trends: a citation network analysis of the learning analytics field

ABSTRACT

This paper provides an evaluation of the current state of the field of learning analytics through analysis of articles and citations occurring in the LAK conferences and identified special issue journals. The emerging field of learning analytics is at the intersection of numerous academic disciplines, and therefore draws on a diversity of methodologies, theories and underpinning scientific assumptions. Through citation analysis and structured mapping we aimed to identify the emergence of trends and disciplinary hierarchies that are influencing the development of the field to date. The results suggest that there is some fragmentation in the major disciplines (computer science and education) regarding conference and journal representation. The analyses also indicate that the commonly cited papers are of a more conceptual nature than empirical research reflecting the need for authors to define the learning analytics space. An evaluation of the current state of learning analytics provides numerous benefits for the development of the field, such as a guide for under-represented areas of research and to identify the disciplines that may require more strategic and targeted support and funding opportunities.

References

1. Baker, R. S. J. D. and Siemens, G., 2013 In press. Educational data mining and learning analytics, Cambridge University.
2. Bastian, M., Heymann, S., and Jacomy, M., 2009. Gephi: An Open Source Software for Exploring and Manipulating Networks. In Proceedings of the Third International AAAI Conference on Weblogs and Social Media (San Jose2009), AAAI Press.
3. Blondel, V. D., Guillaume, J.-L., Lambiotte, R., and Lefebvre, E., 2008. Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment 2008/10/P1008.
4. Bonacich, P., 2007. Some unique properties of eigenvector centrality. Social Networks 29, 4, 555--564.
5. Buckingham Shum, S., Gasevic, D., Ferguson, R., Haythornthwaite, C., and Dawson, S., 2012. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge ACM, New York, USA.
6. Ding, Y., Liu, X., Guo, C., and Cronin, B., 2013. The distribution of references across texts: Some implications for citation analysis. Journal of Informetrics 7, 3, 583--592.
7. Freeman, L. C., 1978. Centrality in social networks conceptual clarification. Social Networks 1, 3, 215--239.
8. Garfield, E., 1955. Citation indexes for science: A new dimension in documentation through association of ideas. Science, New series 122, 108--111.
9. Gasevic, D., Conole, G., Siemens, G., and Long, P. D., 2011. Proceedings of the 1st International Conference on Learning Analytics and Knowledge (LAK'11) ACM, New York, USA.
10. Glass, R. L., Vessey, I., and Ramesh, V., 2002. Research in software engineering: an analysis of the literature. Information and Software Technology 44, 8, 491--506.
11. Gross, P. L. K. and Gross, E. M., 1927. College libraries and chemical education. Science, New series 66, 1713, 385--389.
12. Halevi, G. and Moed, H. F., 2013. The thematic and conceptual flow of disciplinary research: A citation context analysis of the journal of informetrics, 2007. Journal of the American Society for Information Science and Technology 64, 9, 1903--1913.
13. Kitchenham, B., 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Keele University & University of Durham, Retrieved from http://cdn.elsevier.com/promis_misc/525444systematicreviewsguide.pdf.
14. Macfadyen, L. and Dawson, S., 2010. Mining LMS data to develop an "early warning system" for educators: A proof of concept. Computers & Education 54, 2, 588--599.
15. Mählck, P. and Persson, O., 2000. Socio-Bibliometric Mapping of Intra-Departmental Networks. Scientometrics 49, 1, 81--91.
16. Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., and Byers, A. H., 2011. Big Data: The Next Frontier for Innovation, Competition, and Productivity. McKinsey Global Institute.
17. Petersen, K., Feldt, R., Mujtaba, S., and Mattsson, M., 2008. Systematic mapping studies in software engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering (Retrieved from www.bcs.org/upload/pdf/ewic_ea08_paper8.pdf2008).
18. Suthers, D., Verbert, K., Duval, E., and Ochoa, X., 2013. Proceedings of the Third International Conference on Learning Analytics and Knowledge ACM, New York, USA.
19. Tight, M., 2008. Higher education research as tribe, territory and/or community: a co-citation analysis. Higher Education 55, 5, 593--605.
20. Waltman, L., Van Eck, N. J., and Wouters, P., 2013. Counting publications and citations: Is more always better? Journal of Informetrics 7, 3, 635--641.
21. Wasserman, S. and Faust, K., 1994. Social Network Analysis: Methods and applications. Cambridge University Press, New York.
22. Watts, D. J. and Strogatz, S. H., 1998. Collective dynamics of/'small-world/' networks. Nature 393, 6684 (06/04/print), 440--442.
23. White, H. D., 1990. Author co-citation analysis: Overview and defense. In Scholarly communication and bibliometrics, C. L. BORGMAN Ed. Sage, Newbury Park, CA, 84--106.
24. Wieringa, R., Maiden, N., Mead, N., and Rolland, C., 2006. Requirements engineering paper classification and evaluation criteria: a proposal and a discussion. Requirements Engineering 11, 1, 102--107.

Index Terms

• Applied computing

  • Education

  • Enterprise computing