Knowledge Base Scoring System

๐Ÿ“Š Scoring System Overview

Understanding how Evalo calculates evaluation scores using weighted requirements and transparent scoring methodology.

Last updated: 9/6/2025

1. Requirement Levels & Weights

Each requirement has a level that defines its importance and impact on the final score:

  • Must โ†’ weight 1.0 (critical)
  • Should โ†’ weight 0.5 (important, but not critical)
  • Nice โ†’ weight 0.25 (optional, small improvement)

๐Ÿ‘‰ Key Insight

This means a "Must" requirement counts 4ร— more than a "Nice-to-have" requirement in the final score calculation.


2. Requirement Evaluation

Each requirement is evaluated individually with the following possible outcomes:

  • โœ… If a requirement is met โ†’ its full weight is earned.
  • โŒ If a requirement is not met โ†’ its weight is missed.

3. Score Calculation

The final score is calculated using a weighted approach that ensures fairness and transparency:

  1. 1
    Compute the maximum possible score by summing the weights of all requirements.
  2. 2
    Compute the earned score by summing the weights of all requirements that passed.
  3. 3
    Calculate final percentage:

Score Formula

Score = (Earned weight รท Total weight) ร— 100

4. Quick Example

Let's walk through a practical example to see how the scoring system works:

Assessment Setup

Let's say an assessment has:

  • 4 musts, 3 shoulds, 2 nice โ†’

Total weight = (4ร—1.0) + (3ร—0.5) + (2ร—0.25) = 4 + 1.5 + 0.5 = 6.0

Results

Now if results are:

  • Must: 3 passed, 1 failed โ†’ earned = 3.0
  • Should: 2 passed, 1 failed โ†’ earned = 1.0
  • Nice: 1 passed, 1 failed โ†’ earned = 0.25

Final Calculation

Earned = 3.0 + 1.0 + 0.25 = 4.25

Final Score = (4.25 รท 6.0) ร— 100 = 70.8%


โœ… The beauty of this approach is that it's simple, fair, and transparent:

  • Missing musts hurts the score a lot.
  • Shoulds and nice-to-haves let teams improve and optimize, but don't block them.

Understanding Score Ranges

Here's how to interpret different score ranges:

90+

Excellent (90-100%)

All or most requirements met, including most "should" and "nice" items

70+

Good (70-89%)

Most "must" requirements met, some "should" requirements completed

50+

Fair (50-69%)

Some "must" requirements met, room for improvement

<50

Needs Work (<50%)

Many critical requirements missing, significant improvements needed

Next Steps

Now that you understand how scoring works, here are some recommended next steps:


Need Help?

If you have questions about the scoring system or need help interpreting evaluation results, we're here to help: