Research · Round 1

User Testing Findings

5 testers · March 2026 · Task: reply to a customer complaint using SimpleAI

We recruited 5 small business owners matching our target persona — non-technical operators in service businesses — and asked each to complete a 3-step task: set up their business type, generate a reply to a customer complaint, and rate the result. Findings below are unedited and direct.

5/5 Completed the task
4/5 Would use the reply
3 Priority fixes identified

Individual Session Notes

Tester A
Service business owner
Completed · with reservations
"optional" label confusing reply too soft / generic

Would copy and tweak the first line. "Better than me typing it myself at midnight."

"Why does it say 'optional' on the business type box? Then what's the point of it? Just put something in or don't. Stop wasting my time with optional."

Suggested improvement

"Tell me what the reply is going to DO — is it trying to keep the customer or just apologize? I want to pick the goal, not just the tone. Goals matter. Tone is fluff."

Tester B
Yoga studio owner
Completed · positive
unsure how detailed to be in business type

100% yes. "It sounded like me — warm, genuine, not corporate."

"I wasn't sure if I should write my business type like 'yoga studio' or something longer like 'yoga and wellness studio in Brighton.'"

Suggested improvement

"A little example in the business type field — placeholder text that says 'e.g. yoga studio, dog groomer, café.' Just so new users know what level of detail to give."

Tester C
Restaurant owner
Completed · would use as draft only
no customer name field "Dear Customer" feels cold reply too generic

As a draft starter only. "The structure is good — acknowledge, apologize, invite back. But I'd never send it as-is."

"I kept looking for somewhere to add my restaurant's name or the customer's name. The reply just said 'Dear Customer' which felt a bit... cold for something claiming to be friendly."

Suggested improvement

"Let me add a customer name field. Even just a first name. 'Dear Sarah' hits totally differently than 'Dear Customer.' That one fix would make this actually usable for me."

Tester D
Service business owner (Google reviews)
Completed · enthusiastic
confused: whose "tone"? feedback buttons hard to notice

Absolutely. "I've been putting off replying to a Google review for two weeks. This would have saved me so much stress."

"I wasn't sure what 'tone' meant at first — like the tone of their message or my reply? Once I picked one and saw the result I got it, but maybe a little tooltip or example would help?"

Suggested improvement

"Can it also help me reply to good reviews? I struggle with those too — I never know if saying 'Thank you so much!' sounds too simple. I'd use this all the time if it did that."

Tester E
Wedding photographer
Completed · positive
mobile layout cramped copy button gave no confirmation can't regenerate without clearing

Yes. "The Quick tone reply was solid — punchy, not groveling, gets to the point."

"Add a 'copy to clipboard' button that actually flashes or confirms the copy happened. I clicked it and wasn't sure if it worked."

Suggested improvement

"Could you let me regenerate with one click without clearing everything? Sometimes the first draft is close but not quite there."


Cross-Session Themes

Personalization gap

Replies felt generic. "Dear Customer" was cited as the top reason testers wouldn't send the output as-is.

Raised by 3 of 5 testers
Goal vs. tone framing

Testers want to pick the intent of a reply (retain, apologize, resolve), not just its emotional tone.

Raised by 2 of 5 testers
Positive review use case

Multiple testers spontaneously asked if the tool works for good reviews too — a use case not currently surfaced.

Raised by 2 of 5 testers
UI clarity

Small friction points: "optional" label, tone selector label, copy confirmation, mobile layout.

Raised by 3 of 5 testers

Prioritized Next Improvements

  1. 1
    Add a customer name field

    The single highest-impact change. "Dear Customer" is the primary reason testers wouldn't send replies as-is. A first name field would make output feel personal and immediately usable. Mentioned explicitly by 3 testers.

  2. 2
    Replace tone selector with goal + tone

    Add a "What do you want this reply to do?" selector (e.g. Retain customer, Apologize, Resolve a complaint, Thank them) above or alongside tone. The most strategically important feedback — users think in goals, not tones.

  3. 3
    Support positive review replies

    At least 2 testers asked unprompted. Adding a "Reply to a compliment" mode or reframing the tool as "any customer message" (not just complaints) broadens the use case with minimal engineering lift.


Minor UX Fixes (low effort)

Try SimpleAI

Reply to any customer email or review in 10 seconds. Free, no signup.

Try it free →