SPLINTER
A pre-tokenization reduction method for consonantal scripts (abjads) that reduces vocabulary sparsity by mapping words to their consonantal skeletons.
Timeline (last 90 days)
SPLINTER is a pre-tokenization reduction method for abjads (consonantal writing systems), originally used for languages such as Arabic, whose core idea is to map vocabulary to consonantal skeletons to reduce vocabulary sparsity.
FIDEL extends the SPLINTER reduction method from abjad scripts to Ethiopian abugida scripts.
All Facts (2)
SPLINTER is a pre-tokenization reduction method for abjads (consonantal writing systems), originally used for languages such as Arabic, whose core idea is to map vocabulary to consonantal skeletons to reduce vocabulary sparsity.
50%UnverifiedFIDEL extends the SPLINTER reduction method from abjad scripts to Ethiopian abugida scripts.
50%