Testing standard

Tested on thousands of conversations. Before go-live.

Before launch, our team tests your AI employee on your own systems, and you review its real replies. It goes live only after you sign off.

๐Ÿงช Thousands of conversations โฑ 3 to 7 days ๐Ÿ“„ Full report
The standard

Part of every deployment

Every deployment goes through it. Your AI employee goes live after it passes and you sign off.

๐Ÿงช ConversationsThousandsper AI employee, modelled on your real chats
โฑ Duration3 to 7 daysdepending on flows, languages and connected systems
๐Ÿ“„ DeliverableFull reportresults, fixes and open questions in one document
The team

A team owns every stage

AI plays the customer and grades the chats. Our engineers, testers and specialists decide what is tested, what passes and what ships.

AI engineers

Build the test setup on your systems and ship each fix.

QA testers

Confirm every failure is real. Re-run the full suite after each change.

Conversation specialists

Write the hard cases and review every flagged chat for accuracy and tone.

The process

Six steps to sign-off

  1. 1
    Analyse ยท conversation specialists

    Analyse your chat history

    We turn past chats into anonymised outlines (topic, language, timing) and map what customers ask most. No names or phone numbers are used.

    Intent mapLanguagesPeak topics
  2. 2
    Scenarios ยท specialists and engineers

    Build the test scenarios

    Short and long chats in English, Chinese and Malay, plus hard cases written by hand. Each runs on a fresh test contact.

    RescheduleCancelRunning lateMedical questionAsk for a person
  3. 3
    Same environment ยท AI engineers

    Test on your real setup

    An AI customer chats with a staging copy of your setup: the same channel, knowledge sources, CRM, booking systems and API routes.

  4. 4
    Judge and fix ยท QA and specialists

    Grade and fix

    Every reply is checked against your website, price list, CRM and booking system. Each failure is reviewed by a person and fixed at its cause.

    Wrong factMissed handoverWrong languageStuck flowUnsupported claim
  5. 5
    Regression ยท QA testers

    Re-test everything

    Every change re-runs the full suite, so a fix never breaks something that already worked.

  6. 6
    Report ยท the whole team

    Review and sign off

    You receive the full report. Launch happens on your sign-off.

Same environment

What you review is what your customers get

A chatbot tested in a chat window can still fail in production: a slow booking system, a CRM field that does not sync, an outdated knowledge file. We test the full chain.

๐Ÿงช Staging
  • Same WhatsApp channel
  • Same knowledge sources
  • Same CRM, e.g. Salesforce, HubSpot or GoHighLevel
  • Same booking system, e.g. Plato, Cliniko or your calendar
  • Same API routes
โ— Live
  • Same WhatsApp channel
  • Same knowledge sources
  • Same CRM, e.g. Salesforce, HubSpot or GoHighLevel
  • Same booking system, e.g. Plato, Cliniko or your calendar
  • Same API routes
Regression testing

One fix never breaks another

Example: your deposit policy changes. We update the knowledge source and re-run every scenario. The change ships only when the full suite passes.

โš™ Change: deposit policy updated
โœ“Price questionspassed
โœ“Booking flowpassed
โœ“Reschedule and cancelpassed
โœ“Handover to staffpassed
!Chinese repliesfixed, re-run
โœ“Long chatspassed

The held-back set

Conversations we never use for tuning. Passing them shows the AI employee has learned the rule, not memorised the test.

What testing catches

Real issues, found and fixed

From recent deployments, with client details removed.

Aesthetics clinic groupAPI data
Yes! 3pm and 4pm are both open.
Saturday has 10am, 10:30am or 11:30am. Which suits you?

The booking system returned morning slots only. Replies now quote only times the system returns.

Bathroom showroomKnowledge source
The site-visit deposit is refundable when you buy.
The deposit isn't refundable. You receive a voucher instead.

The knowledge source contradicted the website. Corrected to match.

24-hour venue operatorLive check
Sorry, nothing is free in the next 14 days.
Sunday is open. Shall I hold it for you?

A live check now compares each quoted price and slot with the calendar and alerts staff on a mismatch.

Your report

What's in your report

๐Ÿ“Š
Results by round

Pass rates by topic, chat length and language.

โ†”
Before and after

The same conversation before and after each fix.

โœ“
Issues found and fixed

Each failure, its cause and where it was fixed.

?
Questions for you

Decisions only you can make, such as which requests go straight to your staff.

FAQ

Questions about testing

How many conversations do you test before an AI employee goes live?

Thousands per AI employee. They are built from anonymised outlines of your real chats (topic, language and timing) and varied by length and language, plus hard cases our conversation specialists write by hand.

How long does testing take?

Three days to a week. The range depends on how many flows, languages and system connections your AI employee has.

Will the replies I review match what customers get after launch?

Yes. Tests run against a staging copy of your real setup: the same WhatsApp channel, knowledge sources, CRM, booking systems and API routes as the live AI employee.

Do you use my customers' personal data for testing?

No. Each past chat is reduced to an outline of topic, language and timing, with no names or phone numbers. Test conversations run on dedicated test contacts.

What is regression testing?

After every change, the full test suite runs again so that a fix in one place cannot break something that already worked. We also keep a held-back set of conversations that is never used to tune the AI employee, to check it has learned the rule rather than memorised the test.

What is in the test report?

Results for every round, the same conversation before and after each fix, every issue found and how it was fixed, and the questions we need you to answer. Nothing goes live until you have signed off.

What happens after launch?

Where the AI employee quotes prices or availability, a live checker can compare each reply against your real system and alert your staff when one does not match. When you change a price or policy, we update the source and re-run the suite.

See your AI employee's replies before your customers do

Message us on WhatsApp. We will show you how testing would work for your business.

Message us on WhatsApp