Exhaustive Word Ablation
A text preprocessing evaluation method that determines the optimal stop-word set by systematically removing each candidate word from the vocabulary one at a time and measuring its effect on a downstream classification task. This exhaustive approach eliminates confirmation bias introduced by selective validation.
Timeline (last 90 days)
The paper proposes an exhaustive word ablation method that removes each of approximately 18,500 candidate words one by one to directly measure its impact on classification results.
The paper proposes that the exhaustive ablation method can be generalized to any inherited preprocessing default settings, not just stopwords.
All Facts (2)
The paper proposes an exhaustive word ablation method that removes each of approximately 18,500 candidate words one by one to directly measure its impact on classification results.
50%UnverifiedThe paper proposes that the exhaustive ablation method can be generalized to any inherited preprocessing default settings, not just stopwords.
50%