Unverified50% confidenceEventExact time
schemagate achieved an F1 of 0.83 in a 200-question pilot test, and 32 of the 33 false rejections stemmed from a regex bug: the check failed to correctly handle uppercase AS (such as FROM students AS T1), causing aliases to be misread as table names and the query to be rejected.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/17/2026
First Seen
Valid until: 10/31/2026
Sources
Related Entities
Related Claims
UnverifiedBy adding to the prompt 'you are seeing part of this database; if you need more information, refuse to answer', schemagate reduced incorrect answers from 16% to 5% in a 100-question pilot.65% similarUnverifiedFour types of errors that can invalidate Schema include: markup that contradicts visible page content, orphaned nodes, stale facts, and silent validation errors.64% similarUnverifiedFailover should not be triggered for every error; a malformed prompt will fail across all providers, so inputs should be validated first.63% similarUnverifiedIn a failover architecture, a distinction should be made between errors worth retrying (429, 5xx, timeouts) and errors that should not be retried (400 parameter errors, 401 authentication failures).62% similarVerifiedFailure modes (e.g., {"error": ...}) should be explicitly defined and validated at the code layer, transforming drift from silent wrong answers into catchable exceptions.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1053848API
curl https://kongchang.com/api/v1/knowledge/claims/1053848MCP
get_claim(id=1053848)