Unverified50% confidenceFactExact time
S3 and Google Cloud Storage are not hierarchical POSIX file systems, and when the engine lists 500,000 files in a single partition it must page through hundreds of metadata pagination markers.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe storage layer of a cloud data warehouse uses inexpensive object storage (such as S3), and the compute layer can dynamically add or remove nodes according to query load.60% similarUnverifiedWhen a table contains 4 million 120 KB small files, the manifest files themselves can number in the thousands and total several GB, and merely reading this metadata tree can exhaust the Trino coordinator's heap space.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1027906API
curl https://kongchang.com/api/v1/knowledge/claims/1027906MCP
get_claim(id=1027906)