Unverified50% confidenceFactExact time
Without validation, 12.8% of the fine-tuned model's invoices have validation-coverage field errors.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn manually proofread samples, the character error rate was only 0.68% when the text was clearly legible, but approximately 45% of sampled passages were completely uncorrectable due to source quality issues.77% similarUnverifiedIn 11 of the 12 models, between 87.5% and 100% of capitulation cases stopped at the exact wrong number provided by the user, meaning capitulation typically involves switching sides entirely.75% similarUnverifiedThe Expected Calibration Error (ECE) increased in seven out of eight event pairs, and in affected scenarios, 12%–51% of the area was confidently mislabeled by the model with near-zero accuracy.75% similarUnverifiedIn a verbatim-quotation benchmark spanning 13 models, 2 instruction variants, and 962 scored responses, not a single model corrected any planted error within a quotation.71% similarUnverifiedOn a test set of 600 synthetic invoices, the QLoRA fine-tuned model achieved a full-invoice exact rate of 83.0%, an auto-approval rate of 86.8%, and 0 out of 461 validation-coverage field errors in approved invoices (upper bound 0.8%).71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1036985API
curl https://kongchang.com/api/v1/knowledge/claims/1036985MCP
get_claim(id=1036985)