Needle 2
An inference engine supporting grammar-constrained function calling. It applies grammar constraints to the vocabulary during decoding, restricting the output space to valid function names and argument structures. It is primarily used for routing and structured decision-making rather than open-ended generation.
Timeline (last 90 days)
The ACT layer of VQ Agent Core is handled by needle_router.py, which underneath uses grammar-constrained function calling of Needle 2 (cactus-needle==2.0.15).
The Needle 2 of VQ Agent Core runs in-process via ctypes on desktop, or connects over HTTP to the serve mode of the needle CLI binary, which is also used for Termux/Android deployments.
All Facts (2)
The ACT layer of VQ Agent Core is handled by needle_router.py, which underneath uses grammar-constrained function calling of Needle 2 (cactus-needle==2.0.15).
50%UnverifiedThe Needle 2 of VQ Agent Core runs in-process via ctypes on desktop, or connects over HTTP to the serve mode of the needle CLI binary, which is also used for Termux/Android deployments.
50%