Metamorphic Testing
A software testing method that checks program correctness by identifying necessary relations that should hold between inputs (metamorphic relations), without requiring expected outputs or manual annotation. It is suited to domains lacking benchmark answers.
Timeline (last 90 days)
LGMT is an open-source tool that detects reasoning inconsistencies in large language models through metamorphic relations based on first-order logic.
Metamorphic testing detects model behavior under predefined equivalence relations, and the design quality of the equivalence relations themselves affects the detection coverage.
All Facts (2)
LGMT is an open-source tool that detects reasoning inconsistencies in large language models through metamorphic relations based on first-order logic.
50%UnverifiedMetamorphic testing detects model behavior under predefined equivalence relations, and the design quality of the equivalence relations themselves affects the detection coverage.
50%