Bootstrapping
A nonparametric resampling statistical method that estimates the empirical distribution of a statistic by drawing subsamples with replacement. It is used to construct confidence intervals and to assess the determinacy of rankings.
Timeline (last 90 days)
In document parsing evaluation, documents rather than paragraphs or pages are used as the resampling unit for bootstrapping because pages and paragraphs within the same document are correlated in layout, fonts and scan quality, and resampling at a finer granularity would underestimate variance and produce overly narrow confidence intervals.
If the number of test documents is very small (e.g., fewer than 30), the interval estimates from bootstrapping are themselves unreliable, and the sample should be expanded.
The bootstrapping resampling process should fix a random seed to ensure that the confidence intervals produced from the same per-document results are consistent across runs.
The bootstrapping concept originally referred to a compiler written in a programming language compiling that language itself—the first C compiler was written in C.
All Facts (4)
In document parsing evaluation, documents rather than paragraphs or pages are used as the resampling unit for bootstrapping because pages and paragraphs within the same document are correlated in layout, fonts and scan quality, and resampling at a finer granularity would underestimate variance and produce overly narrow confidence intervals.
50%UnverifiedIf the number of test documents is very small (e.g., fewer than 30), the interval estimates from bootstrapping are themselves unreliable, and the sample should be expanded.
50%UnverifiedThe bootstrapping resampling process should fix a random seed to ensure that the confidence intervals produced from the same per-document results are consistent across runs.
50%UnverifiedThe bootstrapping concept originally referred to a compiler written in a programming language compiling that language itself—the first C compiler was written in C.
50%