Unverified50% confidenceBenchmarkExact time
Using the UniQL evaluator on Oracle Free 23ai, the schemagate + Gemini 2.5 Flash combination reached 69.9% accuracy after adding an error-repair loop, but this score is mainly attributable to the repair loop rather than the model's own capability.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/20/2026
First Seen
Valid until: 1/18/2027
Sources
Related Entities
Related Claims
UnverifiedA developer using the lightweight model Gemini 2.5 Flash together with the schemagate tool raised first-attempt accuracy on the UniQL Oracle benchmark from 35.0% to 64.5%.75% similarUnverifiedBoth Gemini 2.5 Pro and Gemini 2.5 Flash accurately identified the conceptual errors in the unlearning code and used the original forget set labels in their fixes.72% similarUnverifiedIn a test with max_tokens set to 16, Gemini 2.5 Flash-Lite reported 12 reasoning tokens, with an empty visible reply.68% similarUnverifiedWhen the total was obscured but each line item was visible, Claude and Gemini 3 Flash got all 48 correct, with all failures coming from the smaller models (Flash-Lite failed 31%, nano failed 79%), and nano got only 12/48 correct even when explicitly instructed to add up the items.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1073561API
curl https://kongchang.com/api/v1/knowledge/claims/1073561MCP
get_claim(id=1073561)