Joint paper with Andrey Ekhmenin, ANDEKS
Silence Rather Than Error
For leaders and AI evaluatorsWhat checking one public AI agent through two independently applied approaches revealed: an agent can say nothing false and still leave the customer without an answer the company has already published.
What does it mean for a customer-facing AI agent to answer correctly? In August 2026, Sergei Ponomarev and Andrey Ekhmenin, founder of ANDEKS, examined the same live public support agent through two independently applied approaches. Each froze his findings before seeing the other's. Ponomarev compared the company's public promises with the customer's experience through a test purchase; Ekhmenin assessed which conclusions the available evidence could actually support. Neither approach identified incorrect information in the answers examined. But questions about restrictions, refunds and personal data exposed a different problem: the agent did not convey conditions its own company had already published. The paper distinguishes a legitimate admission of uncertainty from silence about an available public rule. It also explains where the approaches differed over response speed, round-the-clock availability and the source of an answer, and proposes assessing factual correctness, absence of invention, completeness of relevant published rules and resolution of the customer's question separately. The six-page article sets out the findings, practical implications and evidence limitations, including incomplete preservation of the test-purchase recordings and limits on session independence. This is a study of one agent in specific scenarios, not a certification, legal opinion or general quality rating.
What's inside · 6 pages
- How two researchers fixed their findings independently before comparing results
- The shared finding: accurate answers can still omit a company's published conditions
- Three observed gaps: service restrictions, refund conditions and personal data processing
- The difference between justified uncertainty and failing to convey an available public rule
- Why observed speed, sampled availability and matching facts support different kinds of conclusion
- Four assessment axes: correctness, no invention, relevant rules and resolution of the customer's question
- Practical lessons for companies, with explicit limits on the evidence and the conclusions
Download the PDF — free
No email, no registration. Just take it and use it today.
Download Silence Rather Than Error →