Unverified50% confidenceDecision RuleExact time
For a dense 27B model, --max-num-seqs 128 is a suitable batch limit; its inflection point comes earlier than that of the A3B MoE architecture, for which 160 is a better setting.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/15/2026
First Seen
Valid until: 1/13/2027
Sources
Related Entities
Related Claims
UnverifiedOn dense mid-scale models (such as 27B), the AMD R9700 leads significantly; on MoE models the two are roughly on par; and on small workloads the B70 has a slight edge.71% similarUnverifiedAgens Volundr 32B is a dense architecture with approximately 32B parameters and 72 layers in total, of which only 18 layers retain KV cache.71% similarUnverifiedThe minimum hardware requirement to run the Origin Prompt Assistant is 16 GB of RAM (32 GB for greater stability), and an Nvidia discrete GPU with 16 GB of VRAM can run a 27B quantized model.70% similarUnverifiedThe B300 variant features enhanced memory capacity and bandwidth configurations, making it suitable for running ultra-large models at the 700B parameter scale.69% similarUnverifiedQwen3-235B-A22B adopts a MoE architecture, activating only 22B out of 235B total parameters at a time.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1033160API
curl https://kongchang.com/api/v1/knowledge/claims/1033160MCP
get_claim(id=1033160)