Creating Test Questions in Ultra

Calculated formulas allow instructors to generate random question by defining a range for a given variable, then a formula is used to calculate the correct answer for each variable option.

Creating Calculated Formula Questions

Question Text and Formula

1. In the field titled, Write the Question Text, enter the question which will appear to students, and include the variables as letters in brackets. These variables you will define a range for later.

2. In the field titled, Enter the Answer Formula, enter the formula used to derive the answer. Optionally, check Display formula to students, if you want students to be able to see the formula during the assessment.

3. Click Next

Answer Settings

1. Specify the format of the answer

   1. Normal: A decimal or whole number without scientific notation. For example, 2.5, or 200.

   2. Exponential: An answer expressed in Scientific notation or with some other exponential notation. For example, 2 E 2 or 2.35 E -15.

2. Specify the expected rounding, and check Display place settings of significant figures if you want students to see the rounding guidance.

3. Specify how to score answers within a given range.

   1. Allow full credit if answer is within a chosen range: Select either Number or Percent from the drop down menu, and enter the number of percent variation that is an accepted answer for full credit.

   2. Allow partial credit if answer is within a chosen range: Select either Number or Percent from the drop-down menu, and enter the number or percent variation that is accepted for partial credit. Specific the amount of credit a student will earn for a answer within that range.

4. Specify if units are required, and if so, enter the expected unit

5. Define the variable range. This is used to calculate the answers based on the answer formula defined in Part 1.

6. Specify the number of answer sets. This is the number of different possible combinations you want to create for students. For example, if you have a single variable with a range from 0 to 100, and you specify 10 answer sets be generated, then 10 numbers in the range 0 to 100 will be used to generate 10 answers. These are the only 10 variables that a student may see on the exam.

7. Click Next

Verification

1. Check the formula is calculating as expected, and the answers are correct.

   1. Repopulate answer set: If you change the variable range, this will populate the field with values from the new range.

   2. Calculate answers: This will calculate the answers for all the variables in the answer set.

2. Optionally, enable and provide an Automated Feedback.

3. Set the points possible for the question.

4. Click Save

A calculated numeric is a short answer question where the solution is a number.

Creating a Calculated Number Question

1. Enter the question text which will be displayed to students.

2. Enter the correct answer. Instructors can specific the answer using integer, decimal or E notation, however constants such as e or pi are not allowed.

3. Optionally, specify if the answer should be in the form of a range. In this case, students will be prompted to enter the range of possible answers.

4. Optionally, specify any Automated Feedback that should be provided to students.

5. Click Save

A Essay questions is a question where the response is a sentence or paragraph. In Ultra, the Essay type takes the place of both the Essay, Short Answer and File Upload Questions in Original.

Creating an Essay Question

1. Specify the question text in the text entry box. Optionally, instructors can attached files or embed a video using either the paperclip icon or the small plus sign to the far right of the top edit options bar respectively.

2. Specify the number of possible points.

3. Click Save

Students will receive a similar box to enter their response, where they can either type a response directly or upload a file.

A Fill in the Blank question prompts students to enter one or more missing expressions.

Creating a Fill in the Blank Question

Writing the Question

1. Enter the text of the question with the correct expression in brackets.

2. Optionally, enable and enter any Automated Feedback for students.

3. Specify the number of possible points for the questions.

4. Click Next Step.

Answer Setting

1. Review the location of any blanks. For each blank you will see the correct answer you typed earlier, verify the answer is correct.

2. Choose the desired response type and indicate if the response is Case sensitive.

   1. Exact Match: The student answer is the exact expression specified by the instructor. For example, if the correct answer is first, then 1st would be marked as incorrect.

   2. Contains a Match: The student answer is marked correct if it contains part of the expected correct answer.

   3. Matches a Pattern: A student answer is marked correct if it matches with a regular expression created by the instructor. This can be used to account for some variation in capitalization, or syntax for example.

3. Click Save

A hotspot question presents students with an image in which they drag a pin onto an image to mark their answer. If the pin is within the “hotspot” area that is marked by the instructor, points are received.

Creating a Hotspot Question

1. Write the question text.

2. Upload an image to the page

3. Create a hotspot on the image

   1. Hotspots can be created using the square tool, circle tool, or polygon tool

   2. Select the tool. The square and circle tool creates a square/circle shape when you click and drag out. The polygon tool lets you draw a shape by clicking and dragging until the shape is connected.

4. Mistakes can be erased using the erase hotspots. Click a hotspot and then click Erase Hotspots.

5. Finish setting up the question

   1. Enable whether or not students can see all the hotspot choices.

   2. Check which hotspot(s) are correct. It is possible to only have one or more answers.

   3. Provide a description for each hotspot if applicable

   4. Provide automated feedback if you would like to comment on why a hotspot was correct or incorrect.

6. Click Save