Students can submit their work in Vocareum Notebook and have it be manually graded, auto-graded, or a combination of both. Below we will go over how to set up these grading features:
Manual Grading
Rubrics and Submissions
From the Part settings of your Assignment, navigate to 'Rubrics' and select '+ Grading Criterion'. Add a name to your criterion and determine a Max Score. Select 'Save Part' when you are done.
Now when you visit a student submission you will see the the rubrics options to grade. You can also leave a review comment the student will see once their submission has been graded.
Auto-grading
Cells and Special Tags
Vocareum's Jupyterlab environment provides custom cell types, leveraging NB Grader, to introduce auto-grading to your assignment:
Auto-graded tests
This cell is identified as a test block. The learner will not be able to edit the cell. When selected it, you will be asked to specify a name and points associated with that cell. When auto grading is executed, if an assertion is triggered in this cell, the learner will be assigned maximum points for this item, 0 otherwise.
Read-only
This cell will not be editable by the learner. Before auto-grading this cell will be replaced by the original cell in case the learner submission has any changes to this cell. Best place for instructors to place course content and directions.
Manually graded answer
Auto-graded answer
Creating Auto-graded Tests
Select Configure Workspace from the assignment page to open Jupyterlab.
Right-click in the work folder to upload or create a new notebook
Within your notebook identify the cells you will be using for autograded tests. Choose from the different grading cell types from the dropdown inside the cell.. For this example we will use 'Autograded tests'.
After you have defined the notebook cells, you can select "Publish Notebook" at the top of your lab.
You will be presented with a dialogbox (shown below). Please read carefully and select the options as follows:
The following actions will be performed:
Place a modified copy of this notebook into /voc/startercode with the code between "SOLUTION" and "HIDDEN TESTS" pragmas removed.
An original copy of this notebook will be viewable by graders.
Copy any selected data files in the work area into the startercode folder.
If autograded cells are present:
Create or update Vocareum rubrics based on the names and points of autograded cells.
Generate a grading script for the autograder, with any existing script being overridden.
Select "Start" to deploy the changes. Students should now see the notebook when they start the assignment. When they submit their work, the grading script will autograde the cells.