Automated and load testing of an AI chatbot
Automated and load testing for a public institution’s AI chatbot, run in parallel against production and beta and comparable question by question.
Verifying the chatbot before a release and after it.
A public institution runs an AI chatbot answering questions from foreign-language clients, and needed to verify it before and after releases: that the answers stay correct across environments and that it holds up under concurrent use.
A real browser for correctness, threads for load.
We built a Robot Framework suite driving a real browser: dismissing the cookie bar, asking a question, checking that the question rendered correctly, waiting for the answer and capturing it. The suite runs in parallel against production and the beta environment. Alongside it, a load script in Python.
The actual output of three runs is on hand: answers paired with a measured time for every question.