Trek-Base
A smart home instruction evaluation dataset extended from HomeBench. It tests the diversity of natural language expression through synonymous rewording and colloquial phrasing.
Timeline (last 90 days)
The Trail team extended HomeBench into three datasets: Trek-Base (testing language diversity), Trek-Robust (evaluating robustness to environment changes), and Trek-Memory (evaluating multi-turn dialogue memory capability).
On the Trek-Base dataset, Trail remains competitive, showing that structured decisions do not sacrifice basic understanding capability.
All Facts (2)
On the Trek-Base dataset, Trail remains competitive, showing that structured decisions do not sacrifice basic understanding capability.
50%UnverifiedThe Trail team extended HomeBench into three datasets: Trek-Base (testing language diversity), Trek-Robust (evaluating robustness to environment changes), and Trek-Memory (evaluating multi-turn dialogue memory capability).
50%