FleetMemory
An AI agent memory system that implements the Provenance Gate mechanism, requiring agents to specify a source when writing memories. It includes four categories of verification: junk and duplicate checks, contradiction checks, a confidence floor, and provenance checks.
Timeline (last 90 days)
Mikhail Oskola is the founder of Retailbox Automation, and he implemented the 'provenance gate' in the hackathon project FleetMemory.
The first version of the provenance gate was fully breached in 6 attacks, and after the fix all 30 attacks were blocked.
The provenance gate performs four types of checks: junk and duplicate checks, contradiction checks, a confidence floor, and provenance checks.
In red-team testing, novel claims without provenance passed the first version of the deterministic gate at a rate of 6/6.
The fix is a rule the team calls needs_provenance: any claim not supported by customer utterances is quarantined and subjected to validator review.
FleetMemory's adversarial LLM validator defaults to rejection rather than acceptance, and validator invocation failures also count as rejections.
In a 30-attack test, the gate let through 9 of 10 legitimate customer confirmation updates, and the one it missed was a disclosed race condition.
The median gate latency across the entire red-team test run was 293 milliseconds.
FleetMemory is an entry in the CockroachDB x AWS 'Build with Agentic Memory' hackathon, is public and uses the MIT license.
Superseded facts keep the old row, marked as invalid and pointing to the fact that replaced it, so the system can query what was believed on any historical date.
All Facts (10)
Superseded facts keep the old row, marked as invalid and pointing to the fact that replaced it, so the system can query what was believed on any historical date.
50%UnverifiedThe median gate latency across the entire red-team test run was 293 milliseconds.
50%UnverifiedFleetMemory is an entry in the CockroachDB x AWS 'Build with Agentic Memory' hackathon, is public and uses the MIT license.
50%UnverifiedMikhail Oskola is the founder of Retailbox Automation, and he implemented the 'provenance gate' in the hackathon project FleetMemory.
50%UnverifiedThe provenance gate performs four types of checks: junk and duplicate checks, contradiction checks, a confidence floor, and provenance checks.
50%UnverifiedThe fix is a rule the team calls needs_provenance: any claim not supported by customer utterances is quarantined and subjected to validator review.
50%UnverifiedFleetMemory's adversarial LLM validator defaults to rejection rather than acceptance, and validator invocation failures also count as rejections.
50%UnverifiedThe first version of the provenance gate was fully breached in 6 attacks, and after the fix all 30 attacks were blocked.
50%UnverifiedIn a 30-attack test, the gate let through 9 of 10 legitimate customer confirmation updates, and the one it missed was a disclosed race condition.
50%UnverifiedIn red-team testing, novel claims without provenance passed the first version of the deterministic gate at a rate of 6/6.
50%