Calculated formulas allow instructors to generate random question by defining a range for a given variable, then a formula is used to calculate the correct answer for each variable option.

Creating Calculated Formula Questions

Question Text and Formula

Open

1. In the field titled, Write the Question Text, enter the question which will appear to students, and include the variables as letters in brackets. These variables you will define a range for later.

2. In the field titled, Enter the Answer Formula, enter the formula used to derive the answer. Optionally, check Display formula to students, if you want students to be able to see the formula during the assessment.

3. Click Next

Answer Settings

Open

1. Specify the format of the answer

   1. Normal: A decimal or whole number without scientific notation. For example, 2.5, or 200.

   2. Exponential: An answer expressed in Scientific notation or with some other exponential notation. For example, 2 E 2 or 2.35 E -15.

2. Specify the expected rounding, and check Display place settings of significant figures if you want students to see the rounding guidance.

3. Specify how to score answers within a given range.

   1. Allow full credit if answer is within a chosen range: Select either Number or Percent from the drop down menu, and enter the number of percent variation that is an accepted answer for full credit.

   2. Allow partial credit if answer is within a chosen range: Select either Number or Percent from the drop-down menu, and enter the number or percent variation that is accepted for partial credit. Specific the amount of credit a student will earn for a answer within that range.

4. Specify if units are required, and if so, enter the expected unit

5. Define the variable range. This is used to calculate the answers based on the answer formula defined in Part 1.

6. Specify the number of answer sets. This is the number of different possible combinations you want to create for students. For example, if you have a single variable with a range from 0 to 100, and you specify 10 answer sets be generated, then 10 numbers in the range 0 to 100 will be used to generate 10 answers. These are the only 10 variables that a student may see on the exam.

7. Click Next

Verification

Open

1. Check the formula is calculating as expected, and the answers are correct.

   1. Repopulate answer set: If you change the variable range, this will populate the field with values from the new range.

   2. Calculate answers: This will calculate the answers for all the variables in the answer set.

2. Optionally, enable and provide an Automated Feedback.

3. Set the points possible for the question.

4. Click Save

A calculated numeric is a short answer question where the solution is a number.

Open

Creating a Calculated Number Question

1. Enter the question text which will be displayed to students.

2. Enter the correct answer. Instructors can specific the answer using integer, decimal or E notation, however constants such as e or pi are not allowed.

3. Optionally, specify if the answer should be in the form of a range. In this case, students will be prompted to enter the range of possible answers.

4. Optionally, specify any Automated Feedback that should be provided to students.

5. Click Save

A Essay questions is a question where the response is a sentence or paragraph. In Ultra, the Essay type takes the place of both the Essay, Short Answer and File Upload Questions in Original.

Creating an Essay Question

Open

1. Specify the question text in the text entry box. Optionally, instructors can attached files or embed a video using either the paperclip icon or the small plus sign to the far right of the top edit options bar respectively.

2. Specify the number of possible points.

3. Click Save

Students will receive a similar box to enter their response, where they can either type a response directly or upload a file.

A Fill in the Blank question prompts students to enter one or more missing expressions.

Creating a Fill in the Blank Question

Writing the Question

Open

1. Enter the text of the question with the correct expression in brackets.

2. Optionally, enable and enter any Automated Feedback for students.

3. Specify the number of possible points for the questions.

4. Click Next Step.

Answer Setting

Open

1. Review the location of any blanks. For each blank you will see the correct answer you typed earlier, verify the answer is correct.

2. Choose the desired response type and indicate if the response is Case sensitive.

   1. Exact Match: The student answer is the exact expression specified by the instructor. For example, if the correct answer is “first”, then “1st” would be marked as incorrect.

   2. Contain Match: The student answer is correct if their answer contains one of the specified answers (see #3 below for inputing multiple answers).

      1. For example, if the specified answer is set as “Franklin”

      2. All of the following are also all counted as correct answers:

         1. Benjamin Franklin

         2. Franklin

         3. B Franklin

         4. B. Franklin

         5. Ben Franklin

   3. Matches a Pattern: A student answer is marked correct if it matches with a regular expression created by the instructor. This can be used to account for some variation in capitalization, or syntax for example.

3. You can have multiple acceptable answers by separating it with the semi-colon ;.

   1. For example, a set of correct responses for a single question that asks for famous cities on the east coast could be New York;Boston;Hartford and so on.

4. Click Save

A hotspot question presents students with an image in which they drag a pin onto an image to mark their answer. If the pin is within the “hotspot” area that is marked by the instructor, points are received.

Creating a Hotspot Question

1. Write the question text.

2. Upload an image to the page

3. Create a hotspot on the image

   1. Hotspots can be created using the square tool, circle tool, or polygon tool

      Open

      

   2. Select the tool. The square and circle tool creates a square/circle shape when you click and drag out. The polygon tool lets you draw a shape by clicking and dragging until the shape is connected.

Open

4. Mistakes can be erased using the erase hotspots. Click a hotspot and then click Erase Hotspots.

5. Finish setting up the question

   1. Enable whether or not students can see all the hotspot choices.

   2. Check which hotspot(s) are correct. It is possible to only have one or more answers.

   3. Provide a description for each hotspot if applicable

   4. Provide automated feedback if you would like to comment on why a hotspot was correct or incorrect.

Open

6. Click Save

Requires students to match various prompts with correct answers. For example, associating an animals scientific name with its common name.

Creating a Matching Question

Open

1. Enter the question text that will be displayed to students.

2. Adjust the scoring settings.

   1. Allow Partial Credit: Student receive partial credit for the correct scores.

   2. Allow negative question score: Students lose points for each incorrect match, and a negative score is possible.

3. Complete the pre-created first prompt and answer.

   1. Enter the prompt, which will be shown to students in the order the instructors creates them.

   2. Enter the correct answer for the first prompt, which will be shown to students in a random order

   3. Enter the scoring options for each question.

4. Optionally, if you want to create other pairs, click Create pair.

   1. Enter the Prompt for the new pair.

   2. Enter the correct answer for the new pair.

5. If you want to add a distractor answer, click Add Distractor.

6. Optionally, enable and specify any Automated Feedback to provide to students.

7. Optionally, enable Question metadata.

8. Enter the total possible points for the question or award as Extra Credit.

9. Click Save.

Multiple Choice questions require students to choose one or more correct answers from a list of provided answers.

Creating Multiple Choice Questions

Open

1. Enter the Question Text. This is the prompt that will appear to students, and they will respond based on this question.

2. (Optional) Enable partial or negative credit if applicable.

3. (Optional) Instructors can enable Option Feedback to provide feedback on individual answers.

4. Enter the answer options and check the box next to each correct answer.

   • Click Add Option to include additional possible answers.

   • Use the trash can icon to delete an option.

   • Use the arrow icons to reorder the answer choices.

5. Specify how many options students can select using the Students can select up to dropdown.

6. (Optional) Enable Automated Feedback and enter feedback for correct or incorrect responses.

7. (Optional) Instructors can categorize the question using Question Metadata. This metadata helps identify and organize questions in tests, pools, and question banks.

8. Enter the total possible points for the question, or mark the question as Extra Credit if desired.

When Randomize answers is enabled in Assessment Settings, instructors can lock a specific answer choice in place.

Open

Open

True/False questions prompt students to response with either True or False to a given statement.

Creating a True/False Question

Open

1. Enter the question text which will be shown to students.

2. Select the Answer Options, along with the Correct answer.

   Open

   

3. Optionally, enable and provide Automated Feedback to students.

4. Enable Question metadata to provide identifiable tags for assessment questions.

5. Enter the total possible points or mark the question as Extra Credit.

6. Click Save

A Jumbled Sentence question prompts students to choose from an array of answers to fill in the blank set.

Creating Jumble Sentence Questions

Open

1. Enter the sentence text and add variables.

   1. To create a variable, insert the variable in square brackets within the paragraph. Each variable is automatically recognized as the correct answer.

   2. Variables can consist of letters, digits (0-9), periods ( . ), underscores ( _ ) and hyphens ( - ). Variable names must be unique, and you can't reuse them.

2. Optionally, enter distractors. A distractor is an answer choice that appears for the students as an option for the blanks.

3. To give each correct answer a fraction of the total point value, select Allow Partial Credit.

4. Optionally, enable and provide Automated Feedback to students.

5. Enter the total possible points.

6. Click Save.