Concept
token_type_ids
Input identifiers used in architectures such as PrefixLM to distinguish the prefix (prompt) from the suffix (generated content), typically using 0 and 1 to denote different token types.
Timeline (last 90 days)
Oct 13
When loading the ZY-S1 model, trust_remote_code=True must be set, and token_type_ids must be passed in — 1 for prompt tokens and 0 for generated tokens.
Unverified50%