Skip to main content
The Click to Improve feature allows you to audit and refine your AI’s performance directly from past conversations. This feature helps you identify which source the AI used to generate an answer and allows you to instantly create a new, corrected Q&A pair to improve future accuracy.

Overview

When reviewing chat history, you may find instances where the AI gave a generic answer or slightly misinterpreted a query. Instead of manually going to the Knowledge Base to create a new rule, you can do it directly from the transcript. With this feature, you can:
  • Verify Sources: See exactly which document or text chunk the AI used to generate the response.
  • Edit Content: Modify the user’s question and the AI’s response to be more accurate.
  • Add to KB: Save the corrected version as a separate Q&A entry in your Knowledge Base.

Step-by-Step Guide

1. Navigate to Transcripts

From your Robylon dashboard, click on the Transcripts tab in the sidebar to view your conversation history.

2. Locate the AI Response

Open a conversation and scroll to the specific AI response you wish to audit. You will see a small clickable text labeled Click to improve located immediately below the AI’s generated message.

3. View the Source

Once you click the link, a window will appear displaying the Source Context. This highlights the specific section of your uploaded data (PDF, URL, or Text) that the AI relied upon to formulate that answer.

4. Edit the Question and Answer

In the same window, you will see fields for Question and Answer:
  • Question: This is pre-filled with the user’s query. You can edit this to make it a standard question.
  • Answer: This is pre-filled with the AI’s generated response. You can edit this text to provide the exact, perfect answer you want the bot to give next time.

5. Save as a New Q&A

Once you have refined the text, click the Add QnA button in the bottom right corner. This action does not alter your original source document. Instead, it creates a separate Q&A pair in your Knowledge Base. Moving forward, the AI will prioritize this specific Q&A pair when asked similar questions, ensuring the improved response is delivered.

Best Practices

  1. Generalize the Question: When editing the “Question” field, try to remove specific user details (like names or account numbers) so the Q&A applies to all future users.
  2. Check the Source: If the source context shown is completely irrelevant, it indicates you may need to upload better documentation regarding that topic to your Knowledge Base.