How to Create Weighted and Summed Scores for Application Reviews

Step 1: Create a Scoring Model Table

We strongly recommend outlining your model in a table that includes the criteria, score range, and weight. As you move through the process, you'll add key information to this table, allowing you to quickly reference items as needed.

Step 2: Create Your Evaluation Form

Create an evaluation form that includes 6 Scaled Questions, each corresponding to a value in the scoring model. Below is an example of the Academic Credentials question.

Note the Key of each question: Each response is a data point, or Field, identified by its Key, that can later be extracted and added to other fields. Your updated table, including each question's key, now looks like this:

Step 3: Create a Calculated Field to Sum and Weight the Responses for Each Reviewer

Calculated Fields allow you to add or multiply other fields on the evaluation form to create a summed or weighted evaluation score for each reviewer.

1. Click + Add Calculated Field at the bottom of the form.
2. Title the Calculated Field and choose Number from the Data Type dropdown menu.
3. In the Expression Box, type in the Keys of the fields on the form that you would like to add to eachother. In this example, we want to add and weight our 6 responses, which can be achieved by multiplying integers to the appropriate keys:
   
   
4. Once you have finished your calculations, test it by clicking the Try It ▶ Icon in the top right of the evaluation form. If it is working as expected, click Save Changes to save your progress.

Note: Calculated Fields sum responses on the evaluation form for each reviewer, resulting in multiple values per applicant if multiple reviewers complete the form within that Review Phase. To obtain one value per applicant, you can average, sum, or take the median of all reviewers' Calculated Fields using a Phase Calculated Field, as described below.

Step 4: Link the Evaluation Form to the Review Phase

1. Once the evaluation form is created, link it to the phase during which the review will be conducted. 
   
   
2. While editing the phase, make note of the Key – you'll need this later. In this example, the key is weightedEvaluationReview
   
   
3. While editing the phase, create a Phase Calculated Field for the calculated field that you just created. When creating this phase calculated field, it's important to decide how you will handle multiple reviews for the same applicant—whether to average the weighted review scores, find the median, or sum them. In other words, you're helping the system understand what to do with multiple review scores. In our example, we'll average reviewers' scores of the Weighted Review Total calculated field.
   
    

Step 5: Working with Phase Calculated Fields

The phase calculated field you've just created represents the average of your reviewers' total weighted review scores. This is one numbered value that you can add to the Application Grid and sort by, segment, export it, and add it to to your Summary View. In this example, we have created a phase calculated field whose title is Average Weighted Review and key is avgWeightedReview. Use these attributes to perform the aforementioned processes.

Taking it Further: Creating Calculated Application Properties

Application properties control various aspects of the system. As previously stated, the phase calculated field we just created is a single-valued property that you can segment, export, and sort. Taking it further, you can add it to other applicant properties, such as other phase calculated fields, the Holistic Score, or interview scores by creating a Calculated Application Property. Here we will create a calculated property of the review score added to the Average Interview Score.

1. Start by navigating to Settings, then Application Setup, then Application Properties. Click the pencil icon in the upper-right corner to edit.
   1. Click Calculated Property in the left menu. 
      
      
   2. Enter a label for the calculated field. This field represents the combined review and interview scores, so we'll use “Review Plus Interview Score”. Then, set the data type as Number.
      
      
       
   3. In the Expression section, enter the formula that finds your phase calculated field. That formula is:
      
      phases.weightedEvaluationReview.avgWeightedReview 
      
      Here's how that formula is composed:
       
      •  phases. = the type of data you're using for the calculation, which in this case is phase calculated fields (be sure to include the ending period).
      •  weightedEvaluationReview. = the key of the specific phase with which your phase calculated field is associated. You had identified this key in step 4 (be sure to include the ending period).
      • avgWeightedReview  = the key of the phase calculated field for the weighted review score (do not add anything to the end).  
        
        
   4. Search for the Average Interview Score applicant property and add it to the expression box:
      
      
   5. Click Add to add the field to the system.​​​​​​
   6. Click Save in the upper right corner to save your new field.
      
      Tips: 
      – If you can't remember your key, you can use the Data Dictionary to locate it. Use the Find function in your browser to quickly search for it in the list of fields, then copy and paste the field title into your calculated property expression box.
      – If you have already reviewed candidates, you can use the Try It function on a reviewed applicant to see if your formula works.
      -- You can further weight the different fields by multiplying them by numbers.

Now you have a total review and interview combined score composed of the average weighted sum of all evaluation form questions and the interview score. You can use this score just like any other piece of application data by adding it to the application grid, adding it to the application summary view, creating a segment with it, or exporting it.