New: Boardroom MCP Engine!

Customer service · Chapter 21 of 40

Turn Customer Feedback Into Better Service

Use customer feedback and service metrics to identify recurring problems, measure real resolution, and choose practical improvements.

Updated

Open this chapter’s practice pack

On this page

The team answers faster, the queue looks smaller, and the same customers keep coming back with the same problem. A dashboard can look healthy while the service quietly creates more work.

AI can help compare conversations, group recurring problems, and prepare a useful improvement brief. To do that well, the business needs definitions that survive contact with the records. What counts as a case? What counts as resolution? Who was invited to give feedback, and who actually responded?

Your work product is a service scorecard and one improvement proposal tied to traceable evidence. All figures and feedback excerpts in this chapter are constructed teaching material. They are not measured customer outcomes, observed model results, or findings about Salars.net.

Follow the customer issue across channels

Choose the unit you want to understand. A message, a conversation, a support case, a customer, and an order are different units. Counting them interchangeably can make a recurring issue look like several unrelated successes.

For this pilot, define a case as one customer's specific service issue. Link later messages about that issue to the same case when identity and context support the match. A customer with two unrelated issues may legitimately have two cases. Keep uncertain matches for review rather than merging by name alone.

Use case IDs in the analysis dataset and minimize personal details. Keep original messages available only to the people who need them for review. Before sending material to an AI service, confirm the permitted processing environment and relevant access and retention arrangements.

Include unresolved cases and people who leave the service. A dataset built only from closed tickets or enthusiastic survey responses will miss part of the experience. The UK Government Digital Service recommends gathering feedback at different stages, including when users drop out and at the end of their whole service experience. Those government-service practices are useful design ideas here, not new legal duties for every business. See measuring user satisfaction.

Define the scorecard before interpreting it

Use a small set of measures that answer different questions:

MeasureProposed definition for this exercise
Resolution within seven daysCases with verified issue resolution within seven days of opening, divided by all eligible cases
First-contact resolutionCases resolved during the first interaction, with no same-issue reopening in the seven-day window, divided by all eligible cases
Resolution without transferCases resolved without transfer to another service owner, divided by all eligible cases
Customer recontactCases with at least one customer-initiated repeat contact about the same issue within seven days, divided by all eligible cases
Satisfaction among respondentsPositive responses divided by valid survey responses
Survey response rateValid responses divided by delivered invitations

Seven days is a fictional observation window chosen to make the example consistent. Choose a period that fits your actual service and disclose issues that take longer. Compare only cohorts that have had the full observation window, or label the newer cohort as incomplete.

Record evidence for resolution. A sent message, a transferred ticket, and a timeout are not sufficient on their own. Define what completion means for the issue: a supported answer accepted as answering the question, a verified booking change, or another appropriate outcome.

Track harmful failures separately. An incorrect price, a privacy disclosure, or an unauthorized refund should not disappear inside a high average score. Severity and frequency both matter.

Read a worked service cohort

The practice pack contains twenty fictional cases with a complete seven-day observation window. Twelve reach resolution without transfer, five reach resolution after a handoff and later interaction, and three remain unresolved. Ten of the twenty meet the first-contact definition. Three have a customer-initiated repeat contact; those three eventually resolve within the window.

ResultCalculationMeaning
Resolved within seven days17 ÷ 20 = 85%Seventeen have the specified resolution evidence
Resolved without transfer12 ÷ 20 = 60%Twelve finish with the original service owner
First-contact resolution10 ÷ 20 = 50%Ten satisfy the first-interaction and reopening rule
Customer recontact3 ÷ 20 = 15%Three customers initiate another same-issue contact
Still unresolved3 ÷ 20 = 15%These need continued ownership and action

Do not label 85% as “automated resolution.” The example does not establish unattended handling; staff assistance and review may occur in both routes. Similarly, no transfer does not prove the customer had no further work to do.

The three unresolved cases should remain visible with their missing information and next owner. If the dashboard rewards staff for closing them early, it encourages a better-looking report at the customer's expense.

Keep operational state and customer feedback separate. A case may be resolved correctly and still leave the customer dissatisfied with the delay. A friendly customer may give a positive rating before discovering that the proposed fix does not work.

Put satisfaction in its proper denominator

Suppose all twenty customers receive a survey invitation, ten respond, and eight responses are positive. Satisfaction among respondents is 80%, and the response rate is 50%.

You cannot say that 80% of all twenty customers were satisfied. The ten nonrespondents are unknown. They might include people who were delighted, frustrated, busy, unable to use the survey, or unaware of it.

Keep the question, response scale, invitation method, timing, and eligibility consistent when comparing periods. Moving the survey from after completed service to immediately after a polite acknowledgment changes what it measures. So does inviting only customers whose tickets the team closed quickly.

Use short questions about the actual task. “Did you get the help you needed?” can be paired with “What remains unresolved?” Let people describe the issue without requiring a long form. Consider accessible alternatives for the channels your customers actually use.

Do not let AI invent missing ratings or complete survey responses from the tone of a conversation. A predicted sentiment is a different field with a different evidential status.

Organize feedback without turning interpretation into fact

The following constructed excerpts illustrate why source IDs and case IDs both matter. This separate feedback set is not the twenty-case metrics cohort:

Feedback IDCaseExcerptReview note
F01FBC01“I could not work out how the inspection fee was credited.”Fee explanation
F02FBC01“I asked again because I still did not understand the credit.”Same case as F01; do not count another affected customer
F03FBC02“The old page said $35 and the reply said $45.”Conflicting price information reported; verify the actual page
F04FBC03“I thought asking for Friday meant it was booked.”Request versus confirmation
F05FBC04“No one could tell me who would send the next update.”Ownership of next update
F06FBC05“Great, another answer. I still need someone to solve it.”Do not classify as positive solely because it says “Great”

There are six excerpts and five distinct cases. Fee-related material appears in three excerpts from two cases. Reporting three customers with fee problems would be a counting error. Even the correct two-case count is a statement about this constructed set, not a population estimate.

Ask AI to preserve observations before grouping them. GDS's research-analysis guidance separates what was seen or heard from later interpretation, then groups observations and develops findings and actions. See analysing a research session.

Analyze the supplied service feedback for an improvement review.
Keep exact feedback IDs and case IDs attached to each theme.
Count distinct cases and excerpts separately.

For each theme, provide:
- the supported observation;
- supporting and conflicting evidence;
- a possible explanation labeled as a hypothesis;
- the check needed to investigate it;
- a proposed improvement and appropriate owner role.

Do not infer customer demographics, motives, satisfaction ratings,
root causes, policy changes, or outcomes that the records do not contain.
Keep uncertain, mixed, and serious isolated issues visible.

Investigate the process behind the complaint

“Customers are confused about the fee” identifies a symptom. Possible causes include an old page, incomplete wording, a missing condition in a shortened reply, or inconsistent staff guidance. These require different repairs.

For F03, start by locating the page the customer saw and checking its version at the relevant time. Do not assume the current public page still has the same wording. The statement is evidence of a reported mismatch; confirming where and when it occurred requires more records.

For F04, inspect the form, confirmation screen, message template, and booking record. A clearer bot answer cannot fully fix a button that says “Confirm appointment” when it only submits a request.

For F05, check handoff acceptance and the next-update owner. Rewriting “we'll be in touch” in a warmer voice will not assign responsibility. The service process may need a change before the language can improve truthfully.

Keep a severe isolated issue even if it appears once. Frequency-based summaries can hide rare failures with serious consequences. Ask the reviewer to inspect those cases directly.

Choose one improvement and check whether it helps

For the fee theme, a proposed improvement might be to maintain one approved explanation and update the active page and reply templates that depend on it. Assign an owner, identify the sources, and list the assets affected.

Before rollout, ask suitable participants to explain the fee and credit condition in their own words. In a staff test, include both the current $45 policy and the historical $35 record to check whether the workflow handles them correctly. These are proposed evaluations, not completed tests.

After a real rollout, compare the same outcome definitions over a suitable period, while recording changes in case mix and volume. A before-and-after difference can help identify a pattern; it does not establish causation by itself. Use the experiment principles in Chapter 18 when a controlled comparison is practical and needed.

Review outcomes by relevant service category or channel when the data supports it. An average improvement can hide deterioration in one important route. Avoid conclusions from tiny subgroups, and do not infer sensitive characteristics merely to create more dashboard segments.

Count the work behind the service

Include drafting, source checking, customer contact, handoff work, corrections, and maintenance. In an illustrative planning comparison, twenty cases at eight minutes each require 160 minutes. An assisted workflow at six minutes per case takes 120 minutes; adding thirty minutes of allocated maintenance brings it to 150 minutes. The net difference is ten minutes, not forty.

Those are assumptions for a calculation, not measured savings. They do not establish equivalent quality or a reduction in payroll. If the business uses the released time for other work, describe it as staff capacity.

For the same constructed cohort, 150 minutes of labor at an assumed $30 per hour equals $75. Add $10 of allocated tool costs for $85 total. Divide by seventeen resolved cases and the specified cost is $5 per resolved case. This excludes any unlisted overhead or setup cost and does not provide a valid comparison with another workflow unless its outcomes and costs are measured consistently.

Finish the improvement review with a named owner, a concrete change, the evidence needed to judge it, and a review date. Keep unfinished actions in the operating queue. AI-generated insights become useful when the business changes something, checks the result, and preserves what it learned.

Next: Part 6 moves into Products and Commerce, starting with how to validate an offer before building it.