skip to main content
research-article

Going SOLO to assess novice programmers

Published:30 June 2008Publication History
Skip Abstract Section

Abstract

This paper explores the programming knowledge of novices using Biggs' SOLO taxonomy. It builds on previous work of Lister et al. (2006) and addresses some of the criticisms of that work. The research was conducted by studying the exam scripts for 120 introductory programming students, in which three specific questions were analyzed using the SOLO taxonomy. The study reports the following four findings: when the instruction to students used by Lister et al. - "In plain English, explain what the following segment of Java code does" - is replaced with a less ambiguous instruction, many students still provide multistructural responses; students are relatively consistent in the SOLO level of their answers; student responses on SOLO reading tasks correlate positively with performance on writing tasks; postgraduates students manifest a higher level of thinking than undergraduates.

References

  1. Adelson, B. When novices surpass experts: The difficulty of a task may increase with expertise. Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 3 (1984), 483--495.Google ScholarGoogle Scholar
  2. Biggs, J. B. & Collis, K. F. Evaluating the quality of learning: The SOLO taxonomy (Structure of the Observed Learning Outcome). New York, Academic Press, 1982.Google ScholarGoogle Scholar
  3. Lister, R., Simon, B., Thompson, E., Whalley, J. L., and Prasad, C. (2006). Not seeing the forest for the trees: novice programmers and the SOLO taxonomy. In Proceedings of the 11th Annual SIGCSE Conference on innovation and Technology in Computer Science Education. (Bologna, Italy, June 26 - 28, 2006), 118--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. McKeithen, K., Reitman, J., Rueter, H., & Hirtle, S. (1981). Knowledge organization and skill differences in computer programmers. Canadian J. of Psychology, 13, 307--325.Google ScholarGoogle Scholar
  5. Wiedenbeck, S., Fix, V. & Scholtz, J. (1993) Characteristics of the mental representations of novice and expert programmers: An empirical study. International Journal of Man-Machine Studies, 39, 793--812. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Going SOLO to assess novice programmers

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM SIGCSE Bulletin
      ACM SIGCSE Bulletin  Volume 40, Issue 3
      ITiCSE '08
      September 2008
      362 pages
      ISSN:0097-8418
      DOI:10.1145/1597849
      Issue’s Table of Contents
      • cover image ACM Conferences
        ITiCSE '08: Proceedings of the 13th annual conference on Innovation and technology in computer science education
        June 2008
        394 pages
        ISBN:9781605580784
        DOI:10.1145/1384271

      Copyright © 2008 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 30 June 2008

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader