Leo User Guide

Evaluation Question Types

Updated

Evaluations in Leo support multiple types of questions. Read below to learn more about the different question types as well as different options that can be set for each question in an evaluation.

Question Types

Radio

Radio questions in Leo allow the user to select a single response. The responses are listed in a vertical list below the question prompt.

Radio questions can be summarized by averaging the responses, or by count. If summarized by average, the person editing the evaluation can determine if they would like to include the question in scoring.

There is also an option to include an NA response with radio questions. If selected the question will not be included in the evaluation scoring.

See an example of a radio question in the image below.

Dropdown questions in Leo allow the user to select a single response. The responses are listed in a dropdown list below the question prompt.

Dropdown questions can be summarized by averaging the responses, or by count. If summarized by average, the person editing the evaluation can determine if they would like to include the question in scoring.

There is also an option to include an NA response with dropdown questions. If selected the question will not be included in the evaluation scoring.

See an example of a dropdown question in the image below.

Rubric

Rubric questions in Leo allow the evaluator to select a response along a continuum. After clicking Add Rating, they can select their response and then add a comment if desired (or required). Rubric comments are tied to the response and will show up as comments in the Academic Portrait. 

Leo will always summarize Rubric questions by averaging the responses and the summary response will always be included in scoring.

Rubric comments can be set to optional, required only if a rating is provided, or required regardless of whether a rating is given.

There is also an option to include an NA response with rubric questions. If selected the question will not be included in the evaluation scoring.

See an example of a rubric question in the image below. 

Checkbox

Checkbox questions allow the evaluator to select one ore more responses from a list of options presented vertically below the question prompt.

Checkbox questions can only be summarized by count and will never be included in evaluation scoring.

See an example of a checkbox question in the image below.

Text

Text questions in Leo allow the evaluator to draft their own open-ended response. 

All text question responses will appear individually on summary evaluations and may or may not be de-identified based on the evaluation type and privacy settings set by your Leo administrator.

Text questions are not included in scoring.

See an example of a text question in the image below.

Question Settings

Depending on the question type selected the settings may appear differently and/or be unavailable.

Scoring Options

Radio and dropdown questions allow the option of whether or not you want the questions that are summarized by average to be included in the evaluation score.

This could be helpful in instances where you want to calculate the average response value, but do not want the value to be included in the evaluatee's score.

Summary eval options

Radio and dropdown questions allow the option of how the question will appear on summary evaluations.

Rubric questions will always be summarized by average, and checkbox questions will always be summarized by count.

Average summary option: Leo will calculate the average response value based on the evaluations submitted for a specific individual. Leo will then select the response with the value closest to the average response value. This response will appear on approved summary evaluations.

Count summary option: Leo will count the number of times each response was selected and include that information in the evaluation summary.

Include N/A

Radio and Dropdown questions can optionally include a NA response. When selected on a summary evaluation, the question will be dropped from score calculations for that individual.

Themes

A theme(s) can be associated with any evaluation question. This will allow for robust reporting and visualization associated with responses to a specific evaluation question(s). 

Required or Optional

By default, new questions added to an evaluation will be required. You can choose for a question to be optional if desired.

Previous Article Eval Listing: Create/Edit An Evaluation
Next Article On-Demand Evals