ORC
An open columnar file format optimized for the Hadoop ecosystem, supporting efficient reads and predicate pushdown.
Timeline (last 90 days)
The Lakehouse concept is to store data in open file formats (such as Parquet, ORC) while layering on data warehouse capabilities such as transactions, schema evolution, and time travel, avoiding the data redundancy and synchronization latency caused by running a data lake and a data warehouse as two parallel systems.
A table format maintains a metadata layer on top of immutable open files such as Parquet and ORC (recording which files make up the table, the schema history, and the snapshot of each commit), enabling atomic commits, schema evolution, and time travel without modifying the underlying files.
A data lake typically refers to a system built on low-cost object storage (such as Amazon S3) at its foundation, storing data in columnar formats such as Parquet or ORC.
All Facts (3)
The Lakehouse concept is to store data in open file formats (such as Parquet, ORC) while layering on data warehouse capabilities such as transactions, schema evolution, and time travel, avoiding the data redundancy and synchronization latency caused by running a data lake and a data warehouse as two parallel systems.
50%UnverifiedA table format maintains a metadata layer on top of immutable open files such as Parquet and ORC (recording which files make up the table, the schema history, and the snapshot of each commit), enabling atomic commits, schema evolution, and time travel without modifying the underlying files.
50%UnverifiedA data lake typically refers to a system built on low-cost object storage (such as Amazon S3) at its foundation, storing data in columnar formats such as Parquet or ORC.
50%