Evaluation Settings

Use the Account Manager Evaluation Settings to customize the general Evaluation settings as well as Course, Long Event or Event settings

Path: Admin Toolbar  > Advanced > Account Manager > Modules [expand] > Evaluation Settings [expand]

Max Response Value: The default max value is 20. Any value entered here will override the default.

Program: General Evaluation Settings

Each Program can have its own set of Evaluation parameters, begin by expanding the General Evaluation settings for your Program.

Path: Admin Toolbar  > Advanced > Account Manager > Modules [expand] > Evaluation Settings > Program: General Evaluation Settings [expand]

The following options are available under the General Evaluation settings:

  • Select User picture size: Set the image size for the Evaluatee photo that appears at the top of the Clinical Evaluation. (50 X 50 Tiny or 150 X 150 Medium)
  • Hide inactive Evaluatees: Check this box to hide inactive Evaluatees by default in the Evaluation Workflow.
  • Hide inactive Evaluators: Check this box to hide inactive Evaluators by default in the Evaluation Workflow.
  • Include target user in detail Eval Rpt: Check this box to add the target User data to the detail report available in the Summary Evaluation Report.
    • If the Evaluation is of a Course, Event, or Long Event, this logic does NOT apply.
  • Randomize and de-identify student comments: Check this box to randomize and de-identify Student comments in summary reports. (NOTE: See Warning below)
  • Exclude student summary if N < X: This option will not report summary Student information if the number of Students is less than X. Click the blue link to set this number.
  • Enforce N < X and de-identification rules for admins: By default, Admins and Course Template/Campus Admins and Course Directors are not governed by the N < X rule.
    • Check this box to make it apply to them too.
  • Randomize and de-identify faculty comments: Check this box to randomize and de-identify Faculty comments in summary displays.  (NOTE: See Warning below)
  • Enable automatic Evaluation email reminders: Check this box to turn on the nightly generation of email reminders for active Evaluations.
  • Do Not send reminders for Evals with only a placeholder: Check to suppress sending emails for clinical placeholder Evals with no actual Evaluatees assigned.
  • Send initial reminder: Check this box to make Leo send a reminder on the first day the Evaluation becomes available.
  • Send a reminder every X days: Select the frequency of email reminders in a number of days.
  • Allow targeted no-password required access via email: If you want your Evaluator to be able to access the Evaluation directly from the email reminder, without logging in, check this box.
    • Whether your institution uses the Leo Login page or uses the single sign-on access, by enabling this option the Evaluators who have an Evaluation to complete will be able to access the Evaluation only through the link sent via email and not the rest of the system.
    • To access the rest of Leo a User must log in through the proper channels.  
  • Set Evaluation email to TEST MODE: When Test Mode is enabled, emails will not be created or sent. Check this box when you are testing the system.
  • De-identify student reports: Check this box to de-identify student reports and restrict access to Student reports.  (NOTE: See Warning below)
  • Disable student rules for student peer-Eval summary review: Check this box to enable N < X and reporting rules so that Students CAN see summary reviews of Student Peer-review Evaluations.
    • De-identification will still be enforced.
  • Use Eval Link "Title" rather than Eval Name for display in EWF and Gradebook: Use your custom Evaluation Title.
  • Show Counts and Averages: Check this box to show the counts for each response and the average value on Summary Evaluations.
  • EWF: By Type and Evaluation: Summary by Eval type.
  • Shrink free-form answers to columns in PDF Eval summaries: On PDF view of Eval summaries, the questions is in one column and the answer is in another.
  • Eval reminder consolidation flag: If selected there will be one reminder per Evaluation, if unselected there will be one reminder per User and per Evaluation.
  • Exclude N/A from percentages: This will exclude N/A responses from all percentage calculations.
  • Hide Course Template Evaluator name in Summary Evaluations: This will hide the Course Template Evaluator's name from appearing in the header of Summary Evals.
  • Trigger Evaluation response notification threshold: The number of triggered responses that need to be answered in order for a notification to be sent out. The default is 2.
  • Triggered Evaluation response notification recipient: When the number of triggered responses in an Evaluation exceeds the threshold, this email address will receive notification.
    • This email MUST be linked to a valid Leo User record, ot will will be rejected by the Evaluation system.
  • Allow re-opening of completed Evaluations: This will allow the re-opening of completed Evaluations from completed Evaluation reports.
  • Allow removal of Evaluations from bulk sendouts: This will allow for the removal of individual open or completed Evaluations from their respective reports.
    • Removed Evaluations will not be rebuilt nightly.

De-identification Rules For Summary Reports Notice: If the settings for randomizing/de-identifying comments is set when a summary is approved, then the summary will be frozen with those settings. If the settings change at a later point in time, the Summary report would need to be re-reviewed and re-approved to get updated.

It is important to understand if the de-identification flags are not checked for some reason but you wanted the data de-identified, then you would have to check the flag and re-approve it. In the meantime, some of the data might have been identifiable. When setting up the Leo Evaluation System it is best practice to not go and alter settings after the fact, unless it is absolutely necessary.

Course Evaluation Settings

The options found under the Course Evaluation Settings allow you to enable specific types of Evaluations for the Course Level only.

  • Check the box for the Evaluation Types you would like to have available at the Course Level.

Path: Admin Toolbar  > Advanced > Account Manager > Modules [expand] > Evaluation Settings > Program: Course Evaluation Settings [expand]

EWF stands for Evaluation Workflow, which is the tool that allows Administrative Users to summarize Evaluations and push Evaluations to the Gradebook. If you would like to use the Evaluation Workflow for a specific type of Evaluation at the Course Level, check the corresponding box.

The following are settings specific to Course Evaluations and Evaluation Workflow.

  • Clinical Faculty evaluating Students
  • EWF for Clinical Faculty evaluating Students
  • Faculty evaluating Course
  • EWF for Faculty evaluating Course
  • Faculty evaluating Students
  • EWF for Faculty evaluating Students
  • Students evaluating Clinical Faculty
  • EWF for Students evaluating Clinical Faculty
  • Students evaluating Course
  • EWF for Students evaluating Course
  • Students evaluating Faculty
  • EWF for Students evaluating Faculty
  • Students Peer Evaluation
  • EWf for Students Peer Evaluation
Event Evaluation Settings
  • The options found under the Event Evaluation Settings allow you to enable specific Types of Evaluations for the Event Level only.
  • Check the box for the Evaluation Types you would like to have available at the Event Level.
  • If you would like to be able to use the Evaluation Workflow for a Type of Evaluation at the Event Level, check the corresponding box.

Path: Admin Toolbar  > Advanced > Account Manager > Modules [expand] > Evaluation Settings > Program: Event Evaluation Settings [expand]

  • Faculty evaluating Event
  • EWF for Faculty evaluating Event
  • Faculty evaluating Students
  • EWF for Faculty evaluating Students
  • Students evaluating Event
  • EWF for Students evaluating Event
  • Students evaluating Faculty
  • EWF for Students evaluating Faculty
  • Students Peer Evaluation
  • EWf for Students Peer Evaluation
Long Event Evaluation Settings
  • The options found under the Long Event Evaluation Settings allow you to enable specific Types of Evaluations for the Long Event Level only.
  • Check the box for the Evaluation Types you would like to have available at the Long Event Level.
  • If you would like to be able to use the Evaluation Workflow for a type of Long Event Evaluation, check the corresponding box.

Path: Admin Toolbar  > Advanced > Account Manager > Modules [expand] > Evaluation Settings > Program: Long Event Evaluation Settings [expand]

  • Faculty evaluating Long Event
  • EWF for Faculty evaluating Long Event
  • Students evaluating Long Event
  • EWF for Students evaluating Long Event