[KongchangAI]
BenchmarkSynthetic Context and Ontology for PII Extraction

PII-SCOPE

An open-source reference benchmark for PII detection, intended to address problems in publicly available LLM-generated datasets, including annotation noise, imbalanced distribution of PII types and insufficient contextual realism. By providing a standardized evaluation setting, it supports comparable assessment of different models on personally identifiable information detection tasks, allowing results across models to be measured on a common basis rather than on divergent, privately constructed data.

Timeline (last 90 days)

Nov 3

A 278M-parameter open-weights PII detection model has been released, along with the PII-SCOPE reference benchmark and a technical report.

Unverified50%
Nov 3

The PII-SCOPE benchmark has also gone live on Hugging Face.

Unverified50%
Nov 3

The motivation for building the PII-SCOPE benchmark was to address quality problems prevalent in public LLM-generated datasets (such as annotation noise, imbalanced PII type distribution, and insufficient contextual realism).

Unverified50%
Nov 3

Currently available public information has not yet disclosed the specific scale, PII category coverage, or evaluation metric details of the PII-SCOPE benchmark.

Expired50%

All Facts (3)

Source Articles