Grading at scale in earsketch

ABSTRACT

This paper explores some of the challenges posed by automated grading of programming assignments in a STEAM (Science, Technology, Engineering, Art, and Math) based curriculum, as well as how these challenges are addressed in the automatic grading processes used in EarSketch, a music-based educational programming environment developed at Georgia Tech. This work-in-progress paper reviews common strategies for grading programming assignments at scale and discusses how they are combined in EarSketch to evaluate open ended STEAM-focused assignments.

References

1. Astrachan, Owen, and Amy Briggs. "The CS principles project." ACM Inroads 3, no. 2 (2012): 38--42.
2. Caiza, Julio C., and José María del Álamo Ramiro. "Programming assignments automatic grading: review of tools and implementations." (2013): 5691--5700.
3. Cole, Brian, Daniel Hakim, David Hovemeyer, Reuven Lazarus, William Pugh, and Kristin Stephens. "Improving your software using static analysis to find bugs." In Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications, pp. 673--674. ACM, 2006.
4. Computing Research Association. "Generation CS: Computer Science Undergraduate Enrollments Surge Since 2006. 2017." (2017).
5. Daradoumis, Thanasis, Roxana Bassi, Fatos Xhafa, and Santi Caballé. "A review on massive e-learning (MOOC) design, delivery and assessment." In P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), 2013 Eighth International Conference on, pp. 208--213. IEEE, 2013.
6. DeNero, John, Sumukh Sridhara, Manuel Pérez-Quiñones, Aatish Nayak, and Ben Leong. "Beyond Autograding: Advances in Student Feedback Platforms." In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education, pp. 651--652. ACM, 2017.
7. Edwards, S. H., and Perez-Quinones, M. A. Web-cat: automatically grading programming assignments. In ACM SIGCSE Bulletin, vol. 40, ACM (2008), 328--328.
8. Guzdial, Mark. "A media computation course for non-majors." In ACM SIGCSE Bulletin, vol. 35, no. 3, pp. 104--108. ACM, 2003.
9. Hext, Jan B., and J. W. Winings. "An automatic grading scheme for simple programming exercises." Communications of the ACM 12, no. 5 (1969): 272--275.
10. Maeda, John "STEM + Art = STEAM," The STEAM Journal: Vol. 1: Iss. 1, Article 34. (2013)
11. NEWCITE Magerko, Brian, Jason Freeman, Tom Mcklin, Mike Reilly, Elise Livingston, Scott Mccoid, and Andrea Crews-Brown. "Earsketch: A steam-based approach for underrepresented populations in high school computer science education." ACM Transactions on Computing Education (TOCE) 16, no. 4 (2016): 14.
12. McCoid, Scott, Jason Freeman, Brian Magerko, Christopher Michaud, Tom Jenkins, Tom Mcklin, and Hera Kan. "EarSketch: An integrated approach to teaching introductory computer music." Organised Sound 18, no. 2 (2013): 146--160.
13. Narayanan, N. Hari, Christopher Hundhausen, Dean Hendrix, and Martha Crosby. "Transforming the CS classroom with studio-based learning." In Proceedings of the 43rd ACM technical symposium on Computer Science Education, pp. 165--166. ACM, 2012.
14. Resnick, Mitchel, John Maloney, Andrés Monroy-Hernández, Natalie Rusk, Evelyn Eastmond, Karen Brennan, Amon Millner et al. "Scratch: programming for all." Communications of the ACM 52, no. 11 (2009): 60--67.
15. Spacco, Jaime, David Hovemeyer, and William Pugh. "An Eclipse-based course project snapshot and submission system." In Proceedings of the 2004 OOPSLA workshop on eclipse technology eXchange, pp. 52--56. ACM, 2004.
16. Sumukh Sridhara, Brian Hou, Jeffrey Lu, and John DeNero. 2016. Fuzz Testing Projects in Massive Courses. In Proceedings of the Third (2016) ACM Conference on Learning @ Scale (L@S '16). ACM, New York, NY, USA, 361--367.
17. Tischler, Ron, Robin Schaufler, and Charlotte Payne. "Static analysis of programs as an aid to debugging." In ACM SIGPLAN Notices, vol. 18, no. 8, pp. 155--158. ACM, 1983.
18. Wang, T., Su, X., Ma, P., Wang, Y., Wang, K. Ability-training-oriented Automated Assessment in Introductory Programming Course. Computer. Education, Elsevier, vol. 56, pp. 220--226. 2011

• Social and professional topics

  • Professional topics

    • Computing education

      • Computing education programs