Scoring Applicants

Best Practices in Setting Up a Review Process

If you're just getting started with building a review process in WebAdMIT, we recommend that, where applicable, you complete the following steps in the order listed:

  1. Build a checklist of supplemental requirements for each applicant.
  2. Track applicants during each stage of your admissions process.
  3. Store information in Custom Fields that your program needs but is not collected from the applicant in the CAS application.
  4. Upload documents directly to an application in WebAdMIT, whether it's a document the applicant sends you or one that you want to attach to their file.
  5. Create tasks for reviewers through Assignments, where the reviewer can add their comments and scores.
  6. Create and assign Interviews for reviewers, including tracking the date and location of the interview.
  7. Score applicants based on institutional rating policies.
  8. Depending on your CAS, you may also have access to retrieving background checks.

Additionally, explore these resources for best practices when building a review process:

Video Overview

Building Scoring Models

Reporting on Applicant Scores

Overview

Scoring Models provide a framework for how applicants are scored based on institutional rating policies. Some Scoring Models also use Point Tables that allow you to assign points based on customized point scales. This helps you normalize and assign scores in a standard manner.

Scoring Models are available when working with ListsExports, and Reports.

Gaining Access to This Feature

The Scoring feature is available under the Management panel and access to this tool is controlled through Work Groups. You must have the Configure Software permission to create and edit Scoring Models and Point Tables.

Creating Scoring Models

  1. Using the Menu Bar, open the Management panel, then click Scoring.
  2. Begin by creating a Scoring model.
    1. Click New Scoring Model.
    2. Enter a name and description.
    3. Click Submit to save your template or Return to Scoring to discard your template.

      Scoring Model Template Dec 2022.png
  3. Once you create the Scoring model, then you can add scoring components under it.
    1. Click Edit Model.
    2. Click New Scoring Component to add scorable items. Note that:
      • Not all fields in the application are scorable. You can use a Custom Field to capture items that are not available as scoring components.
      • If you select a scorable item that is text-based (e.g., Military Status), you must use a string Point Table to convert the text to scores.
    3. If necessary, adjust the date range.
    4. If necessary, determine how multiple values are scored. This is required for fields that can have more than one result (e.g., test scores, assignment scores, interview scores, etc.). See the Notes on Standardized Tests and Multiple Values section for more guidance on test scores. The options are:
      • Average: the average score of the selected component.
      • Highest Overall: the component taken from the test with the highest overall score (regardless of whether they scored higher on that selected component in another test).
      • Maximum: the highest score obtained for the selected component.
      • Most Recent: the most recent score for the selected component.
      • Sum: the sum of all instances of the selected component.
    5. If necessary, select a Point Table or enter a multiplier. These options allow you to convert the value from the specified field to another value for weighting or normalizing.
    6. Select the programs associated with the Scoring Model.
    7. Click Submit to save your template or Return to Scoring to discard your template.

      Scoring Model Components Dec 2022.png

Notes on Standardized Tests and Multiple Values

When including standardized test scores in a Scoring Model, the highest score in different sections may not have been obtained in the same test. Review the scenarios below to help determine the best multiple value option to apply.

In this example, the applicant took the GRE test twice, with the scores below.

  Quantitative Score Verbal Score Overall Result
GRE Test 1 550 640 1190
GRE Test 2 530 690 1220

If you select Maximum for Quantitative and Verbal, your Scoring Model pulls Test 1 score (550) for Quantitative and Test 2 score (690) for Verbal. Selecting Maximum for each section creates a "superscore" that presents the best scores for each section, regardless of whether they were obtained during the same session.

If you select Highest Overall for Quantitative and Verbal, your Scoring Model pulls Test 2 score (530) for Quantitative and Test 2 score (690) for Verbal. Selecting Highest Overall uses the score originating from the test with the highest overall result (1220).

The Maximum option can also be used to simulate TOEFL MyBest Scores. MyBest Scores are the combination of an applicant’s best scores for each test section from all of their valid TOEFL scores in the last two years. If desired, you can create a Scoring Model exclusively for TOEFL MyBest Scores by selecting Maximum for each section of the test. The resulting overall score combines the maximum scores, resulting in a "superscore."

Creating Point Tables

Video Overview

Creating a Point Table

Point Tables allow you to normalize values and assign scores in a standard manner to all applicants. Once Point Tables have been added, a Scoring Model can be updated to incorporate it.

Once you save a Point Table template, you cannot change the Point Table Type selection, but you can deactivate the template and create a new one, if necessary. We recommend that you test Point Tables by applying them to your Scoring Model and then reviewing applicable applicants.

For string Point Tables, it's important to confirm that the text in the fields you're scoring on matches the text in your Point Table exactly. For example, the States & Territories Point Table template uses state abbreviations, so for it to work properly, you'll need to pair it with a State Code field instead of a full State Name field. If you build a string Point Table for a Custom Field, be sure to build the Custom Field with a Select From List or Yes/No Value custom field type; you can then standardize the input options in both the Custom Field and Point Table and ensure the Point Table works correctly.

  1. Using the Menu Bar, open the Management panel, then click Scoring.
  2. From the Scoring page, click the Point Tables tab.
  3. Begin by creating a Point Table.
    1. Click New Point Table to create a custom template or click Copy Template to copy and customize a WebAdMIT default template.
    2. Enter a title.
    3. Select a Point Table type, including:
      • Numeric: convert a number into another numeric value (e.g., 0.5 value is awarded 1 point, 1.5 value is awarded 2 points, etc.). This is useful when number conversions do not follow a standard multiplier value.
      • Range: convert a range of numbers into a single numeric value (e.g., GPA values between 3.0 and 3.2 are awarded 5 points). This is useful for GPAs and test scores.
      • String: convert text into a numeric value (e.g., Military Status “Active Duty” value is awarded 2 points).
    4. Enter a description.
    5. Click Submit to save your template or Return to Scoring to discard your template.

      Point Table Template Dec 2022.png
  4. Once you create the Point Table, then you can add the parameters.
    1. Click Edit Table.
    2. Click New Point Table Entry to add conditions.
    3. Click Submit to save your template or Return to Scoring to discard your template.

      Point Table Components Dec 2022.png

Viewing Applicant Scores

Once Scoring Models are created, each applicant will have a score calculated.

  1. To view scores, navigate to the Applicant Details page.
  2. Go to the Scoring panel.
  3. To view how the score was calculated, click Details.
  4. If recent changes to the applicant's score have not taken effect, click Refresh Applicant's Scores.

Scoring Applicant Details Page Dec 2022.png

Managing Scoring Models and Point Tables

To manage existing Scoring Models and Point Tables, click Scoring from the Menu Bar.

Scoring Manager Dec 2022.png

Reordering Scoring Models and Point Tables

Use the grip icon to drag and drop the Scoring Model, scoring components, and Point Table into the preferred order.

Editing Scoring Models and Point Tables

Click Edit Model or Edit Table to edit an existing Scoring Model and Point Table.

Copying Scoring Models

Click Copy Model to copy an existing Scoring Model. This allows you to take the existing Scoring Model's settings and save them under a new name.

Copying Point Tables

Click Copy Table to copy a Point Table.

Deactivating Scoring Models and Point Tables

Click Inactivate Model or Inactivate Table to deactivate Scoring Models and Point Tables.