Unverified50% confidenceEventExact time
In testing, Gemma copied the label "ITBMS 7%" into the itbms field instead of the amount on all six receipts; the fix was to have Gemma return the full printed line and let the code extract the last amount.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedGemma 4 26B terminated with a runtime error before producing a score, because the scoring code assumed at least one sentence would be returned in the correct structured format.64% similarUnverifiedWhen Gemma wrote entire messages directly, it dropped all numbers in 4 out of 4 tests and completely reversed the meaning twice.60% similarUnverifiedAfter re-evaluation, Gemma 12B in non-thinking mode achieved a substantive pass rate of 12/16, while the strict pass rate remained at 4/16.58% similarUnverifiedAfter changing the header identification to have Gemma 4 E2B fill only the three required gaps of date, quantity, and product, all 12 header sets were correct with 0 errors, but the author cautions that the same batch of data was also used for debugging, so 12/12 should be regarded as an optimistic estimate.57% similarUnverifiedThe author empirically compared Gemma 3 1B and 4B: 1B, in the rename scenario, wrote "the app will resend the shelved event" and told the sender to make the change, and both errors were caught by the checks and fell back to the rule answer; 4B took about 16 seconds on a laptop GPU and accurately stated the customer, amount and specific field.56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1070188API
curl https://kongchang.com/api/v1/knowledge/claims/1070188MCP
get_claim(id=1070188)