manifest file
The lowest-level file in Iceberg's hierarchical metadata structure. It records the path, partition information, column-level statistics and file-level statistics of each data file, and is used for partition pruning and file filtering during query planning.
Timeline (last 90 days)
Iceberg is an open table format for data lakes, and its metadata hierarchy is: table metadata JSON → manifest list → manifest file → data file, where each manifest file records data file paths, partitions, column-level statistics and file-level statistics.
Iceberg's manifest files are Avro files, and each entry contains the file path, the partition it belongs to, record count, file size, and statistics such as the upper and lower bounds and null counts for each column; query planning uses these statistics and partition information to prune data files.
All Facts (2)
Iceberg is an open table format for data lakes, and its metadata hierarchy is: table metadata JSON → manifest list → manifest file → data file, where each manifest file records data file paths, partitions, column-level statistics and file-level statistics.
50%UnverifiedIceberg's manifest files are Avro files, and each entry contains the file path, the partition it belongs to, record count, file size, and statistics such as the upper and lower bounds and null counts for each column; query planning uses these statistics and partition information to prune data files.
50%