Vocareum

Students can submit their work in Vocareum Notebook and have it be manually graded, auto-graded, or a combination of both.  Below we will go over how to set up these grading features:

From the Part settings of your Assignment, navigate to 'Rubrics' and select '+ Grading Criterion'. Add a name to your criterion and determine a Max Score.  Select 'Save Part' when you are done.

Now when you visit a student submission you will see the the rubrics options to grade. You can also leave a review comment the student will see once their submission has been graded.

1. From the Part settings of your Assignment, navigate to 'Rubrics' and select '+ Grading Criterion'. Add a name to your criterion and determine a Max Score.  Select 'Save Part' when you are done.
   
    
2. Now when you visit a student submission you will see the the rubrics options to grade. You can also leave a review comment the student will see once their submission has been graded.


The Vocareum Notebook provides custom cell types, leveraging NB Grader, to introduce autograding to your assignment. And for the purposes of autograding you will utilizes the 'Auto-Grader' cell.

Selecting the 'Auto-Grader' box will establish the cell as read-only and create sections to enter the Name and Point value of the test (that will then be added to the grading rubric), and populate the cell with special tags

The tags BEGIN SOLUTION and END SOLUTION will contain the solution the student's work will be graded against.  This tags should be added to a code cell students can interact with.  The tags will not be visible in the student workarea.

The tags BEGIN HIDDEN TESTS and END HIDDEN TESTS will contain an assertion you create to compare the student's solution and what is between the previous SOLUTION tags.  The assertion in this example also contains the messages 'Incorrect' and 'Correct' that will display in the student's notebook cell depending on the outcome of the assertion.

1. Selecting the 'Auto-Grader' box will establish the cell as read-only and create sections to enter the Name and Point value of the test (that will then be added to the grading rubric), and populate the cell with special tags
   
    
2. The tags BEGIN SOLUTION and END SOLUTION will contain the solution the student's work will be graded against.  This tags should be added to a code cell students can interact with.  The tags will not be visible in the student workarea.
   
    
3. The tags BEGIN HIDDEN TESTS and END HIDDEN TESTS will contain an assertion you create to compare the student's solution and what is between the previous SOLUTION tags.  The assertion in this example also contains the messages 'Incorrect' and 'Correct' that will display in the student's notebook cell depending on the outcome of the assertion.
   
    

Once your auto-graded notebook is ready, the Generate Notebook(s) feature will allow Vocareum to strip all the code between the Special Tags in the cells and generate a grading script.  The notebook will then be copied to the startercode directory.  Select 'Generate Notebook(s)' at the top of the workarea to open the options modal.

The 'Generate' menu also contains options to select which notebooks to be released and whether to overwrite the existing grading script with a new one generated form your notebook.  If any data files are detected in the work directory you will be given the option to place them in the startercode directory or, by checking the read-only box, adding the files to the voc/data directory and delivering it to student's workareas in a read-only format. 

Once All of your selections have been made Press 'Generate' to start the process.  You will see a message '## Assignment Update Successful' once the process is finished.

While your notebook is being generated you can view the progress window that appears on the bottom of the modal as well:

1. Once your auto-graded notebook is ready, the Generate Notebook(s) feature will allow Vocareum to strip all the code between the Special Tags in the cells and generate a grading script.  The notebook will then be copied to the startercode directory.  Select 'Generate Notebook(s)' at the top of the workarea to open the options modal.
   
    
2. The 'Generate' menu also contains options to select which notebooks to be released and whether to overwrite the existing grading script with a new one generated form your notebook.  If any data files are detected in the work directory you will be given the option to place them in the startercode directory or, by checking the read-only box, adding the files to the voc/data directory and delivering it to student's workareas in a read-only format. 
   
    
3. Once All of your selections have been made Press 'Generate' to start the process.  You will see a message '## Assignment Update Successful' once the process is finished.
    
4. While your notebook is being generated you can view the progress window that appears on the bottom of the modal as well:
   
     

Enable and customize manual and autograded rubrics in your Vocareum Notebook assignment.

Manual Grading

Rubrics and Submissions

Auto-Grading

Cells and Special Tags

Generate Notebook(s)