Benjamin Clegg
ABSTRACT
The use of autograding to assess programming students may lead to unfairness if an autograder is incorrectly configured. Mutation analysis offers a potential solution to this problem. By simulating student coding mistakes, an automated technique can evaluate the fairness and completeness of an autograding configuration. In this paper, we introduce a set of mutation operators to be used in such a technique, derived from a mistake classification of real student solutions for two introductory programming tasks.
- National Academies of Sciences, Engineering, and Medicine, Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. The National Academies Press, 2017.Google Scholar
- C. Douce, D. Livingstone, and J. Orwell, "Automatic test-based assessment of programming: A review," J. Educ. Resour. Comput., 2005. Google ScholarDigital Library
- N. C. C. Brown and A. Altadmri, "Novice Java programming mistakes: Large-scale data vs. educator beliefs," Trans. Comput. Educ., 2017. Google ScholarDigital Library
- J. Breitner, M. Hecker, and G. Snelting, "Der grader Praktomat," Automatisierte Bewertung in der Programmierausbildung, 2017.Google Scholar
- R. A. DeMillo, D. S. Guindi, W. McCracken, A. J. Offutt, and K. King, "An extended overview of the Mothra software testing environment," in Workshop on Software Testing, Verification, and Analysis, IEEE, 1988.Google Scholar
- J. H. Andrews, L. C. Briand, and Y. Labiche, "Is mutation an appropriate tool for testing experiments?," in ICSE '05, pp. 402--411, ACM, 2005. Google ScholarDigital Library
- R. Just, D. Jalali, L. Inozemtseva, M. D. Ernst, R. Holmes, and G. Fraser, "Are mutants a valid substitute for real faults in software testing?," in FSE 2014, pp. 654--665, ACM, 2014. Google ScholarDigital Library
- Google, "Google Java style guide." https://google.github.io/styleguide/javaguide.html#s4.4-column-limit. {Online; accessed 27-Sept-2018}.Google Scholar
- H. Keuning, B. Heeren, and J. Jeuring, "Code quality issues in student programs," in ITiCSE '17, pp. 110--115, ACM, 2017. Google ScholarDigital Library
- Y. Jia and M. Harman, "An analysis and survey of the development of mutation testing," IEEE Transactions on Software Engineering, vol. 37, pp. 649--678, Sept 2011. Google ScholarDigital Library
Recommendations
On automated grading of programming assignments in an academic institution
Practise is one of the most important steps in learning the art of computer programming. Unfortunately, human grading of programming assignments is a tedious and error-prone task, a problem compounded by the large enrolments of many programming courses. ...
Interface-based programming assignments and automatic grading of java programs
ITiCSE '07: Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science educationAutoGrader is a framework developed at Miami University for the automatic grading of student programming assignments written in the Java programming language. AutoGrader leverages the abstract concept of interfaces, as implemented by the Java interface ...
Interface-based programming assignments and automatic grading of java programs
Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education (ITiCSE'07)AutoGrader is a framework developed at Miami University for the automatic grading of student programming assignments written in the Java programming language. AutoGrader leverages the abstract concept of interfaces, as implemented by the Java interface ...
Comments