Set up confidence threshold
To ensure the quality of the answers generated by the Bot using LLM technology (GPT), EM&AI provides an algorithm to check the reliability of the answers and ensure the Bot's answers are within the threshold. Trust is established in advance by the user.
At Settings -> select the KB - Confidence interval
KB - Confidence interval is the confidence interval of the response calculated & checked based on the degree of compatibility with data in the Knowledge Base. If the content of the response is closer to the content in the Knowledge Base, the confidence interval of that response is higher, conversely, if the content of the response is more dissimilar to the content in the Knowledge Base, then The lower the confidence interval of that response.
The recommended confidence interval from EM&AI should be around 10% -> 40% for the Bot to achieve the most optimal response performance. Depending on the Bot's need for accuracy or creativity, users can adjust it accordingly.
The system will eliminate responses whose confidence is lower than the confidence interval set by the user. If the user sets the GPT response confidence interval = 0% to 100% -> The system will not apply the algorithm to check the reliability of the response.
In case the response has a confidence level lower than the Confidence Interval that the user has set, the system will replace that response with the default response set by the user below.
Last updated
