Data Lineage
A set of techniques and methods for recording the end-to-end flow of data from its original sources to final outputs. Data lineage supports data auditing, compliance verification, and root-cause tracing, and is particularly critical in financial and accounting contexts.
Timeline (last 90 days)
Traditional lineage tracking tools rely on instrumentation at each stage of the pipeline, collecting metadata and visualizing data flow in a graph structure.
Traditional lineage tracking tools know where the data has been, but cannot explain why a particular step caused data loss.
Data Lineage tracking records the complete path of data from generation to flow, satisfying compliance audit requirements.
The traceability of "data lineage" is critically important in financial scenarios, as regulators and auditors require every financial figure to be traceable back to the original source document.
Data lineage is particularly important for regulated industries such as finance and healthcare, as it provides column-level traceability.
Unity Catalog's lineage feature automatically captures table-level and column-level dependencies in Spark jobs and SQL queries without requiring manual annotation by users.
All Facts (6)
Traditional lineage tracking tools rely on instrumentation at each stage of the pipeline, collecting metadata and visualizing data flow in a graph structure.
50%UnverifiedTraditional lineage tracking tools know where the data has been, but cannot explain why a particular step caused data loss.
50%UnverifiedData Lineage tracking records the complete path of data from generation to flow, satisfying compliance audit requirements.
50%UnverifiedThe traceability of "data lineage" is critically important in financial scenarios, as regulators and auditors require every financial figure to be traceable back to the original source document.
50%UnverifiedData lineage is particularly important for regulated industries such as finance and healthcare, as it provides column-level traceability.
50%UnverifiedUnity Catalog's lineage feature automatically captures table-level and column-level dependencies in Spark jobs and SQL queries without requiring manual annotation by users.
50%