OpenLineage
An open-source data lineage standard under the LF AI & Data Foundation. It provides a unified lineage event format independent of schedulers and compute engines. Its core model comprises three object types—Job, Run and Dataset—and supports extensible facets.
Timeline (last 90 days)
Snowflake's External Lineage API accepts lineage events in OpenLineage format and merges them directly into the lineage graph, and this mechanism is already GA.
OpenLineage is an open-source data lineage standard under the LF AI & Data Foundation, originally initiated by Datakin (now Astronomer), with the goal of providing a unified lineage event format independent of schedulers and compute engines.
OpenLineage's core model consists of three types of objects—Job, Run and Dataset—connected by inputs/outputs edges.
OpenLineage events are sent as JSON payloads, typically containing fields such as eventType, eventTime and producer, as well as extensible facets.
Snowflake currently recognizes only two OpenLineage facets, datasetType and columnLineage, and other facets such as documentation and ownership are silently ignored.
Snowflake accepts OpenLineage format at the /api/v2/lineage/external-lineage endpoint and merges it into the lineage graph.
All Facts (6)
Snowflake's External Lineage API accepts lineage events in OpenLineage format and merges them directly into the lineage graph, and this mechanism is already GA.
50%UnverifiedOpenLineage is an open-source data lineage standard under the LF AI & Data Foundation, originally initiated by Datakin (now Astronomer), with the goal of providing a unified lineage event format independent of schedulers and compute engines.
50%UnverifiedOpenLineage's core model consists of three types of objects—Job, Run and Dataset—connected by inputs/outputs edges.
50%UnverifiedOpenLineage events are sent as JSON payloads, typically containing fields such as eventType, eventTime and producer, as well as extensible facets.
50%UnverifiedSnowflake currently recognizes only two OpenLineage facets, datasetType and columnLineage, and other facets such as documentation and ownership are silently ignored.
50%UnverifiedSnowflake accepts OpenLineage format at the /api/v2/lineage/external-lineage endpoint and merges it into the lineage graph.
50%