Evaluations in Leo support multiple types of questions. Read below to learn more about the different question types as well as different options that can be set for each question in an evaluation.
Radio
Radio questions in Leo allow the user to select a single response. The responses are listed in a vertical list below the question prompt.
Radio questions can be summarized by averaging the responses, or by count. If summarized by average, the person editing the evaluation can determine if they would like to include the question in scoring.
There is also an option to include an NA response with radio questions. If selected the question will not be included in the evaluation scoring.
See an example of a radio question in the image below.
Dropdown
Dropdown questions in Leo allow the user to select a single response. The responses are listed in a dropdown list below the question prompt.
Dropdown questions can be summarized by averaging the responses, or by count. If summarized by average, the person editing the evaluation can determine if they would like to include the question in scoring.
There is also an option to include an NA response with dropdown questions. If selected the question will not be included in the evaluation scoring.
See an example of a dropdown question in the image below.
Rubric
Rubric questions in Leo allow the evaluator to select a response along a continuum. After clicking Add Rating, they can select their response and then add a comment if desired (or required). Rubric comments are tied to the response and will show up as comments in the Academic Portrait.
Leo will always summarize Rubric questions by averaging the responses and the summary response will always be included in scoring.
Rubric comments can be set to optional, required only if a rating is provided, or required regardless of whether a rating is given.
There is also an option to include an NA response with rubric questions. If selected the question will not be included in the evaluation scoring.
See an example of a rubric question in the image below.
When using an NA response, you cannot include another response with a zero ('0') value. You can include a response with a 0 value or an NA response, but not both.
Checkbox
Checkbox questions allow the evaluator to select one ore more responses from a list of options presented vertically below the question prompt.
Checkbox questions can only be summarized by count and will never be included in evaluation scoring.
See an example of a checkbox question in the image below.
Text
Text questions in Leo allow the evaluator to draft their own open-ended response.
All text question responses will appear individually on summary evaluations and may or may not be de-identified based on the evaluation type and privacy settings set by your Leo administrator.
Text questions are not included in scoring.
See an example of a text question in the image below.
Text questions have an additional setting to "Include in MSPE". This is in reference to the Medical Student Performance Evaluation (formerly the "Dean's Letter"). If selected, the questions will automatically be marked as mandatory. Once approved, the comments entered here will be available to be used in the student's MSPE letter.
This setting should only be used on forms that are used for evaluating students (e.g. faculty evaluation of students, clinical faculty evaluation of students).
Depending on the question type selected the settings may appear differently and/or be unavailable.
Scoring Options
Radio and dropdown questions allow the option of whether or not you want the questions to be included in the evaluation score.
Rubric questions will always be included in form scoring.
This could be helpful in instances where you want to calculate the average response value, but do not want the value to be included in the evaluatee's score.
If you have individual responses that you want to indicate a "N/A" response - in other words, remove this question from scoring only if the particular response is selected - you should designate this when editing the response settings.
Summary eval options
Radio and dropdown questions allow the option of how the question will appear on summary evaluations.
Rubric questions will always be summarized by average, and checkbox questions will always be summarized by count.
Average summary option: Leo will calculate the average response value based on the evaluations submitted for a specific individual. Leo will then select the response with the value closest to the average response value. This response will appear on approved summary evaluations.
Count summary option: Leo will count the number of times each response was selected and include that information in the evaluation summary.
Themes
A theme(s) can be associated with any evaluation question. This will allow for robust reporting and visualization associated with responses to a specific evaluation question(s).
Required or Optional
By default, new questions added to an evaluation will be required. You can choose for a question to be optional if desired.
