Students can submit their work in Colab and have it be manually graded, auto-graded, or a combination of both. Below we will go over how to set up these grading features:

Cells and Grading Types

Vocareum's lab environment provides custom cell types to introduce manual and auto-grading to your assignment:

Manually graded answer

This cell is used for adding manual grading. Once selected, you will need to enter a name for the test in the grading rubric and assign a point value. The rubric entry and point value will be shown when manually grading a student submission.

Auto-graded answer

This is the solution block used in auto-grading. With this grading type selected anything a student adds between the special tags
### BEGIN SOLUTION and ### END SOLUTION
will be compared against the auto-graded tests answer (below).

Auto-graded tests

This is the test block used in auto-grading. The learner will not be able to edit the cell. When selected it, you will be asked to specify a name and assign a point value. If an assertion is added between the special tags
### BEGIN HIDDEN TESTS and ### END HIDDEN TESTS
and triggered by the grading script, then the learner will be assigned either the maximum number or no points for this item.

Read-only

This cell will not be editable by the learner. Before auto-grading, this cell will be replaced by the original cell in case the learner submission has any changes to this cell. Best place for instructors to place course content and directions.

Manual Grading

Rubrics and Submissions

There are two ways to add grading criteria for a manually graded assignment
1. From the Part settings of your Assignment, navigate to 'Rubrics' and select '+ Grading Criterion'. Add a name to your criterion and determine a Max Score. Select 'Save Part' when you are done.
2. When in the teacher authoring environment create a cell in your notebook and set the grading type to "Manually graded answer". Then set the rubric name and point value.
Now when you visit a student submission you will see the rubrics options to grade. You can also leave a review comment the student will see once their submission has been graded.

Auto-grading

Creating Auto-graded Tests

Select Configure Workspace from the assignment page to open the instructor authoring environment.
Right-click in the work folder to upload or create a new notebook
Within your notebook, identify the cells you will be using for auto-graded tests. Choose from the different grading cell types from the dropdown inside the cell. For this example we will use 'Auto-graded answer' and 'Auto-graded tests'.
After you have defined the notebook cells, you can select "Publish Notebook" at the bottom right of your lab.

You will be presented with a dialog box (shown below). Please read carefully and select the options as follows:
1. The following actions will be performed:
  - Place a modified copy of this notebook into /voc/startercode, with the code between "SOLUTION" and "HIDDEN TESTS" pragmas removed.
    An original copy of this notebook will be viewable by graders.
  - If auto-graded cells are present:
    Create or update Vocareum rubrics based on the names and points of auto-graded cells.
    Generate a grading script for the auto-grader, with any existing script being overridden.
Select "Start" to deploy the changes. Students should now see the notebook when they start the assignment. When they submit their work, the grading script will auto-grade the cells.