Overview
Instead of manually testing your chatbot one question at a time, KB Testing allows you to:- Bulk-test questions: Upload dozens or hundreds of questions in one go.
- Auto-generate answers: The system runs each question through the KB agent and records the AI’s response.
- Review and grade: Inspect each answer, check the sources used, and mark it as positive or negative.
- Export results: Download the full test as a CSV with questions, answers, grades, and notes.
Accessing KB Testing
- Log in to your Robylon dashboard.
- From the left sidebar, navigate to Knowledge Base.
- Click the Testing tab below the KB Gap section.
- Name — The name of the test (clickable to open the individual test view).
- Total Questions — The number of questions in the test.
- Status — The current state of the test: Running, Partially Reviewed, or Reviewed.
- Run Date — The date and time the test was created, along with who ran it.
Creating a Test
1. Open the Create Test Modal
Click the + Create Test button in the top-right corner of the Testing page.2. Enter a Test Name
Provide a name for your test in the Test Name field. This is a required field.3. Upload Your Questions CSV
Upload a CSV file containing the questions you want to test. You can drag and drop the file or click Upload CSV to browse your files. The CSV must contain a Question column header. Click the Download Sample CSV link to get a template with the correct format.4. Start the Test
Click Start Test to begin. The modal closes and your test appears in the list with a Running status. The KB agent processes each question in the background and the status updates automatically as answers are generated.Reviewing a Test
Click on any test name in the list to open the individual test view. This page contains the following sections:Stats Widget
A summary bar at the top shows four metrics:- Total Questions — The total number of questions in the test.
- Positive Reviews — The count of answers graded as positive (shown in green).
- Negative Reviews — The count of answers graded as negative (shown in red).
- Pending Reviews — The count of answers not yet reviewed (shown in orange).
Q&A List
Below the stats widget, a table lists every question in the test with the following columns:- Question — The full question text (clickable to open the review slider).
- Answer Status — Shows whether the KB agent successfully generated an answer.
- Answer Rating — The current feedback status: Pending, Good, Acceptable, or Bad.
Evaluating Individual Answers
Click on any row in the Q&A list to open the Evaluate Answer slider on the right side of the screen. The slider contains:Question and Answer
The question is displayed at the top, followed by the AI-generated answer. Both fields are read-only.Cited KB Source
An expandable accordion showing the KB sources the AI used to generate the answer. This works the same way as the Click to Improve feature — you can see exactly which documents or text chunks were referenced.Review Answer
Grade the answer using one of the available rating options: Good, Acceptable, or Bad. If you select Bad, additional options appear for tagging the reason for failure: Hallucination, Incomplete, Wrong source, or Other. At least one reason must be selected. An Add internal note text area is always available for adding free-form feedback regardless of the grade. Click Save to record your review, or Cancel to discard changes and close the slider.Bulk Actions
To speed up the review process, you can select multiple Q&As using the checkboxes and apply feedback in bulk:- Mark as Positive — Applies a positive rating to all selected Q&As at once.
- Mark as Negative — Applies a negative rating to all selected Q&As at once.
Downloading Test Results
You can download test results in two ways:- From the Testing page: Select one or more tests using the checkboxes and click the Download icon. Multiple tests are packaged into a zip file.
- From the individual test view: Click the Download icon in the top-right corner of the test page.
