This article is intended for instructors looking to use Peer Review for Assignments in Ultra.

Overview

If enabled, Peer review allows learners to provide anonymous assignment feedback to their peers.

• Anonymous peer feedback is delivered along with the instructor’s score and feedback.

• Once enabled, the assignment will have a submission window and a peer review window.

• Peer feedback can be hidden by the instructor if necessary.

• Peer feedback is anonymous:

  • Submitters will never see the names of reviewers;

  • If submitters don’t include their names on their submissions, reviewers also won’t see the name of the submitter.

  • Instructors/TAs will see the names of everyone.
    
    

Setting up a Peer Review Assignment

1. In your Ultra course, create an Assignment. For instructions see: Creating Assignments in Ultra.

2. Once created, click the gear icon to open the Assignment Settings.

   Open

   

3. Under the Evaluation options, check the Peer review box, then click Select peer settings.

   Open

   

4. From the Peer review Settings, you can set.

   1. Reviews Per Student: The number of submissions each student is assigned to review. By default, these reviews will be shown to students when grades are posted. It is possible for a submission to receive more than this number of reviews, and by default those additional reviews are hidden from students. Submissions are assigned for review randomly and automatically, further a student may be assigned to review their own submission.

   2. Assessment Due Date: The date after which new submissions are marked as Late. Late submissions are still accepted, and placed into a pool at the time of submission. Students who begin their reviews after this submission are eligible to review the late submission.

   3. Peer Review Due Date: The final date by which Peer Reviews must be submitted.

5. Click Save to save and exit the Peer Review settings window.

6. Click Save to save and exit the Assignment settings window.

Using Peer Review for Assignments

• Like other assessments, a linked Gradebook column is created when the assignment is created. This column is for the instructor’s grade.

• A rubric can be attached for instructor/TA grading, however Peer reviewers cannot view/use this rubric for their peer review.

  • To provide criteria or questions to guide Peer reviewer feedback, you can include those in the Assignment instructions (which will be visible for students during Peer review), or an alternative location.

Grading Peer Review Assignments

1. To view student submissions, navigate to the Assignment in your Ultra course.

2. Click on the Assignment’s name.

3. Next, click the Submissions tab.

4. The Submissions tab will display the status of Submissions, Grading, Peer Reviews, and Posting.

   • Grading status: If an attempt has been graded by the instructor, it will show as “Nothing to reconcile”.

   • Peer Reviews: This column shows the status of the reviews they have provided others.

5. To view a student’s submission or start grading, click on a student’s name.

6. A new window will show their submission, the reviews they provided for their peers, and the feedback they received.

   1. The reviews a student provided to others are located at the bottom, below the submission itself.

7. On the gray bar across the top of the window, just below the student’s name, you will see the grading pill, and can enter a grade for the student.

8. Under the Feedback For Student, instructors can provide their own additional feedback.

   1. Once grading and feedback has been entered and posted, instructor and peer feedback will be visible to students.

9. As with regular Assessments, grades are not visible until they are posted. Navigate back to the Submissions tab, and click either Post on a single student, or Post all grades to post grades for all students. For more information, see Posting Grades in Ultra Course View.

Hiding Peer Reviews from students

If you decide that the Peer Feedback that’s been provided is inappropriate or detrimental, you can hide the peer feedback.

1. Peer Feedback can be hidden from the Submission Grading view.

2. The Peer Feedback can be located under the Instructor Feedback for student box.

3. To hide the feedback, click the small eye icon.

4. Once clicked, the eye will have a line through it, indicating the hidden status.