Receipts
An open-source tool for analyzing the test quality of code changes. It prints how each PROVEN test fails against the old code, helping distinguish whether a test dies at the import stage or reaches the assertion stage.
Timeline (last 90 days)
The authors published a study of 181 real code changes, in which the statement that "all tests in 10% of agent PRs fail on the old code" is incorrect.
The tool Receipts now prints how each PROVEN test failed on the old code, to show whether the test reached the assertion rather than dying at the import stage.
Receipts is an open-source, free tool, whose code repository is at https://github.com/syntaxixr/receipts and whose study document is at docs/study.md in the repository.
Legion's context gateway consists of three components: Observations, Receipts, and the Read Ledger.
All Facts (4)
Receipts is an open-source, free tool, whose code repository is at https://github.com/syntaxixr/receipts and whose study document is at docs/study.md in the repository.
50%UnverifiedLegion's context gateway consists of three components: Observations, Receipts, and the Read Ledger.
50%UnverifiedThe authors published a study of 181 real code changes, in which the statement that "all tests in 10% of agent PRs fail on the old code" is incorrect.
50%UnverifiedThe tool Receipts now prints how each PROVEN test failed on the old code, to show whether the test reached the assertion rather than dying at the import stage.
50%