Ai Scorecards

Prev Next

Let’s talk Quality Assurance (QA). Continuous coaching and performance monitoring drive better customer service, client retention, and employee motivation.

AIScorecards automate call grading with objective, actionable insights—no manual effort required. With ready-to-use templates, you can get started instantly, all within the Dialpad app!

Let's dive into the details.

Who can use this

AIScorecards can be used in Contact Centers and Coaching Teams, for users with Dialpad Support and Dialpad Sell accounts.

Contact us today to enable AIScorecards for your team (there is an additional fee for this feature).

Create a scorecard

Create a traditional scorecard or add AIQuestions to your scorecard. Using AIQuestions automates call grading, reducing the time managers spend manually reviewing calls or shadowing agents.

To create an AIscorecard, go to your Dialpad Admin Settings.

  1. Select AIScorecards > Select Create Scorecard

  2. Enter the name and description of your scorecard

    1. Every scorecard must have a unique name.

  3. Select which Contact Center or Coaching Team can use the scorecard

    1. Scorecards can be applied to a single Contact Center or Coaching Team, or multiple.

    2. Unless specified, a scorecard is assigned to all Contact Centers and Coaching Teams.

  4. Choose how you want the scorecard to be graded

    1. Grade by Ai: All calls are fully automated and graded by Ai.

    2. Suggestions by Ai: AIwill grade the call, but a supervisor will still need to review the grade and submit the final score.

    3. AIoff (Manual grade): No AIassistance, the supervisor will need to manually review and grade each scorecard.

  5. Select the AIQuestions you want to use

    1. If AIis off, you cannot add AIQuestions.

  6. Select Create scorecard

  7. Review each question and edit as needed. You can:

    1. Change the points allocated to each outcome.

    2. Add a comment field and make it mandatory.

    3. Allow a question to be skipped.

    4. Automatically fail an entire scorecard for a certain response.

  8. Add additional questions as needed

    1. To add more AIQuestions, select Add AIQuestions

    2. To create your own question, select Create new question

      Mandatory question content

      Every question must have the following components:

      • Question title:  Question or statement to be considered when grading the call

      • Response type: Yes/no, agreement (Likert), frequency (Likert), importance (Likert), likelihood (Likert), or quality (Likert)

        • AIquestions can only be yes/no. If you choose a different response type, the question will revert to a traditional (non-Ai) question and will not be scored by Ai.

        • AIAutomated Scorecards provide a 'Yes' or 'No' answer, while AISuggested Scorecards only give a 'Yes.' If no answer is detected, the grader scores it manually.

        • Responses are auto-filled to match the response type chosen but are customizable.

      • Points: Point value given for each response

      Optional question content

      Get granular by adding any of the following optional question features:

      • Add a comment: Creates an open text box allowing graders to add comments.

        • A comment field can be added for each question — all grading comments appear on the detailed scorecard exports.

        • The comment field can be mandatory or optional.

      • Allow question to be skipped: Marks the question as N/A without affecting the agent's overall score.

        • AIAutomation can be added to a question but AIwill not select N/A for an answer.  

        • N/A responses need to be manually changed within the scorecard.

        • AIAutomation currently only supports yes/no answers.  

      • Automatically fail entire scorecard for certain responses: When selected, this feature automatically fails the entire scorecard, giving the agent a 0% grade.

        • A scorecard can have multiple questions marked to be automatically failed.

      • Save question as a template: Saves the AIquestion, allowing you to re-use it in different scorecards

  9. Once you've finished adding and editing questions, select Publish

  10. Select Yes, publish now to complete the scorecard creation

Multiple choice questions

Multiple choice questions must be graded manually and cannot be added to an AIAutomated scorecard.

Within the response dropdown, scorecard creators can select multiple choice as a new response type.

How multiple choice questions work:

  • Each multiple choice question can include up to 10 total response options.

    • If a "Skip" option is included, it counts as one of the 10, allowing up to 9 additional custom response choices.

  • You can assign a maximum score to the question, but the individual response values do not need to add up to that score.

    • Multiple choice questions are designed to support more than one correct answer, which allows for different combinations of responses to reach the full score.

    • The system calculates a proportional score, meaning the agent’s score for that question will reflect the percentage of correct answers chosen—up to 100%.

Non-score impacting follow up questions

Use follow up questions to provide more clarity and context within scorecards. These non-score impacting questions enable graders to capture more detailed feedback when a primary question warrants additional explanation.

Each follow-up question can include:

  • A title

  • A response type:

    • Single Selection

    • Multiple Choice

    • Open Response

Change scorecard grading method

While the scorecard is in draft mode, you can change between the three different grading options.

To change a grading type:

  1. Select the scorecard (remember, it must be in draft mode)

  2. Select the current grading method

  3. Choose the new grading method from the dropdown

  4. Select Save

Notes

If you change the grade type from Grade by Ai to Suggestions by Ai, the scorecard will still use AIfeatures, but it will only select a Yes response instead of Yes or No during the call. The graders will then need to submit the final grade manually.

If the scorecard grade type is changed from Grade by Ai to AIoff (manual grade), the scorecard will lose all AIfunctionality, and all questions must be answered manually by the supervisor or grader. If a scorecard with AIquestions is switched to AIoff (manual grade), you can change it back to Suggestions by Ai again.

However, if you want to change the scorecard back to Grade by Ai, you'll need to change all question response types to Yes or No and re-add any trigger words or phrases, as these are removed when you switch to AIoff (manual grade).

Edit trigger words and phrases

The more a scorecard is used, you may realize you forgot a few trigger words and phrases. Don’t worry, these can be updated.

To edit trigger words and phrases go to your Dialpad Admin Settings.

  1. Select AIScorecards

  2. Select AIQuestions

  3. Beside the questions, select Options

  4. Select Edit

  5. Add new phrases or trigger words, or delete unwanted ones

  6. Select Save

Archive a scorecard

Workflows adapt, and your scorecard needs will change as your company grows. AIScorecards can be archived, which maintains the card's analytics data.

To archive a scorecard, head to your Dialpad Admin Settings.

  1. Navigate to AIScorecards

  2. Beside the scorecard, select Options

  3. Select Archive

  4. When prompted, select Yes, Archive — remember this action is not reversible

Finding archived scorecards

Archived scorecards can be viewed at any time using the Archived filter.

Duplicate a scorecard

Need to create a copy of a scorecard? No problem.
To duplicate an AIScorecard, go to your Dialpad Admin Settings.

  1. Select AIScorecards

  2. Beside the scorecard, select Options

  3. Select Duplicate

  4. Review the copy of the scorecard, then select Publish

  5. When prompted, select Yes, publish now

Digital Scorecards

Digital Scorecards let supervisors and admins manually evaluate digital interactions across any supported channel in Dialpad. While AIgrading isn’t available yet, this feature helps teams assess agent performance and maintain quality standards.

Learn more.

More information

For more information on using AIScorecards and the granular data they provide, be sure to read these Help Center articles.

Learn more

Check out Dialpad University's free courses covering our products and services, as well as insightful tips and best practices.