http://dl.acm.org/ft_gateway.cfm?id=2810041&ftid=1688832&CFID=768694308&CFTOKEN=19928950
8.4.2016

Coderunner:
A Tool for Assessing
Computer
Programming Skills
By Richard Lobb and Jenny Harlow,
The University of Canterbury


How should we assess programming skills? Asking students
to write code in a traditional hand-written exam can
produce results like those in Figure 1. It is nearly impossible
to meaningfully grade such code. With sufficient effort one
can get some idea of whether the general idea is correct, but
to assess programming skill we need much more than this.
For example, there will almost certainly be errors in the
code; how do we know whether the student would be able to
correct those errors or not?
...

INTRODUCING CODERUNNER
CodeRunner [1,2,6] is a free and open-source Moodle [3] ques-
tion-type plug-in that lets teachers set questions where the an-
swer is program code. Students develop and test their code us-
ing a normal development environment and submit the code to
CodeRunner through a web browser only when they believe it is
correct. A key assumption behind CodeRunner is that the quiz
in which the questions appear is running in Moodle’s adaptive
mode, which gives students immediate feedback on the correct-
ness of their answer and allows them to resubmit for a penalty.