Elizabeth Patitsas
Jesse Berlin
Abstract
Although it has never been rigorously demonstrated, there is a common belief that grades in computer science courses are bimodal. We statistically analyzed 778 distributions of final course grades from a large research university and found that only 5.8% of the distributions passed tests of multimodality. We then devised a psychology experiment to understand why CS educators believe their grades to be bimodal. We showed 53 CS professors a series of histograms displaying ambiguous distributions that we asked them to categorize. A random half of participants were primed to think about the fact that CS grades are commonly thought to be bimodal; these participants were more likely to label ambiguous distributions as "bimodal." Participants were also more likely to label distributions as bimodal if they believed that some students are innately predisposed to do better at CS. These results suggest that bimodal grades are instructional folklore in CS, caused by confirmation bias and instructor beliefs about their students.
- Ahadi, A., Lister, R. Geek genes, prior knowledge, stumbling points and learning edge momentum: parts of the one elephant? In Proceedings of the Ninth Annual International ACM Conference on International Computing Education Research, ACM, 2013, 123--128.Google Scholar
Digital Library
- Basnet, R.B., Payne, L.K., Doleck, T., Lemay, D.J., Bazelais, P. Exploring bimodality in introductory computer science performance distributions. EURASIA J. Math. Sci. Technol., 14 (2018), 10.Google Scholar
- Eysenck, M.W., Mogg, K., May, J., Richards, A., Mathews, A. Bias in interpretation of ambiguous sentences related to threat in anxiety. J. Abnorm. Psychol. 2, 100 (1991), 144.Google Scholar
- Goodman, S. A dirty dozen: twelve p-value misconceptions. In Seminars in Hematology, Volume 45. Elsevier 2008, 135--140.Google ScholarCross Ref
- Gould, S.J. The Mismeasure of Man. WW Norton & Company, 1996.Google Scholar
- Guzdial, M. Anyone can learn programming: Teaching > genetics, 2014.Google Scholar
- Guzdial, M. Teaching computer science better to get better results, 2014.Google Scholar
- Guzdial, M. Learner-centered design of computing education: Research on computing for everyone. Synth. Lect. Hum. Cent. Inform. 6, 8 (2015), 1--165.Google Scholar
- Guzdial, M. Source of the "geek gene"? Teacher beliefs: Reading on Lijun Ni, learning from Helenrose Fives on teacher self-efficacy, 2015.Google Scholar
- Heilman, M.E., Block, C.J., Stathatos, P. The affirmative action stigma of incompetence: Effects of performance information ambiguity. Acad. Mgmnt. J. 3, 40 (1997), 603--625.Google Scholar
- Jost, J.T., Banaji, M.R., Nosek, B.A. A decade of system justification theory: Accumulated evidence of conscious and unconscious bolstering of the status quo. Polit. Psychol. 6, 25 (2004), 881--919.Google Scholar
- Kahan, D.M., Peters, E., Dawson, E.C., Slovic, P. Motivated numeracy and enlightened self-government. Yale Law School, Public Law Working Paper, (307), 2013.Google Scholar
- Leslie, S.-J., Cimpian, A., Meyer, M., Freeland, E. Expectations of brilliance underlie gender distributions across academic disciplines. Science 6219, 347 (2015), 262--265.Google Scholar
- Lewis, C. Attitudes and beliefs about computer science among students and faculty. SIGCSE Bull. 2, 39 (2007), 37--41.Google Scholar
- Lister, R. Computing education research geek genes and bimodal grades. ACM Inroads 3, 1 (2010), 16--17.Google Scholar
- McDonald, J.H. Handbook of Biological Statistics, Volume 2. Sparky House Publishing, Baltimore, MD, 2009.Google Scholar
- Padavic, I., Ely, R.J. The work-family narrative as a social defense, 2013.Google Scholar
- Park, T.H., Saxena, A., Jagannath, S., Wiedenbeck, S., Forte, A. Towards a taxonomy of errors in HTML and CSS. In Proceedings of the Ninth Annual International ACM Conference on International Computing Education Research, ACM, 2013, 75--82.Google ScholarDigital Library
- Payne, B.K., Shimizu, Y., Jacoby, L.L. Mental control and visual illusions: Toward explaining race-biased weapon misidentifications. J. Exp. Soc. Psychol. 1, 41 (2005), 36--47.Google Scholar
- Petersen, A., Craig, M., Zingaro, D. Reviewing CS1 exam question content. In Proceedings of the 42nd ACM Technical Symposium on Computer Science Education, SIGCSE'11 (New York, NY, USA, 2011). ACM, 631--636.Google ScholarDigital Library
- Razali, N.M., Wah, Y.B. Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors and Anderson-Darling tests. J. Stat. Model. Anal. 1, 2 (2011), 21--33.Google Scholar
- Rosenthal, R. Teacher expectancy effects: A brief update 25 years after the pygmalion experiment. J. Res. Educ. 1, 1 (1991), 3--12.Google Scholar
- Rossiter, M.W. Women Scientists in America: Struggles and Strategies to 1940, Volume 1. JHU Press, 1982.Google Scholar
- Sahami, M., Piech, C. As CS enrollments grow, are we attracting weaker students? In Proceedings of the 47th ACM Technical Symposium on Computing Science Education, SIGCSE'16 (New York, NY, USA), 2016. ACM, 54--59.Google ScholarDigital Library
- Schilling, M.F., Watkins, A.E., Watkins, W. Is human height bimodal? Am. Stat. 3, 56 (2002), 223--229.Google Scholar
- Wikipedia. Multimodal distribution---wikipedia, the free encyclopedia, 2016 [online; accessed 6-April-2016].Google Scholar
- Wikipedia. Normal distribution---wikipedia, the free encyclopedia, 2016 [online; accessed 6-April-2016].Google Scholar
- Zingaro, D., Petersen, A., Craig, M. Stepping up to integrative questions on cs1 exams. In Proceedings of the 43rd ACM Technical Symposium on Computer Science Education. ACM, 2012, 253--258.Google ScholarDigital Library
Index Terms
- Evidence that computer science grades are not bimodal
Recommendations
Evidence That Computer Science Grades Are Not Bimodal
ICER '16: Proceedings of the 2016 ACM Conference on International Computing Education ResearchIt is commonly thought that CS grades are bimodal. We statistically analyzed 778 distributions of final course grades from a large research university, and found only 5.8% of the distributions passed tests of multimodality. We then devised a psychology ...
Examining Interest and Grades in Computer Science 1: A Study of Pedagogy and Achievement Goals
Computer Science 1 (CS1), the first course taken by college-level computer science (CS) majors, has traditionally suffered from high failure rates. Efforts to understand this phenomenon have considered a wide range of predictors of CS success, such as ...
Comments