
Differential Privacy
Differential privacy limits how much one protected contribution can change the probability of an analysis output. Its guarantees depend on the privacy definition, parameters, implementation, and repeated releases.
来源
完整课程摘要
A school wants to report patterns in study activity without making an individual learner's participation easy to detect. Removing names is not sufficient when other information can reconnect a record to a person. Differential privacy approaches the problem differently: it constrains how much the probability of an analysis output can change when a protected contribution is added or removed. The guarantee concerns the behaviour of a randomized computation, under a specified definition of neighbouring datasets.
Imagine two datasets that are identical except for one student's contribution. A differentially private mechanism aims to make the probability distributions of its possible outputs sufficiently similar across those datasets. Carefully calibrated randomness is a common way to achieve this. The goal is not to make every released statistic false or to promise that no information about anyone can ever be inferred. It limits the additional disclosure associated with the protected contribution under the mechanism's assumptions.
The definition of a contribution is crucial. Protecting one event is different from protecting all events associated with one person. Parameters, often written epsilon and delta, express parts of the privacy guarantee. Smaller epsilon generally represents a stronger constraint, but comparing systems also requires knowing the neighbouring-dataset definition, delta, and the full analysis process. Repeated releases can accumulate privacy loss, so a collection of individually protected outputs still needs an overall accounting strategy.
For an illustrative classroom demonstration, use fictional completion counts from several tutorial groups. Release a noisy count for each group, then examine how the results affect conclusions about participation. Small groups may be especially difficult to describe accurately under a fixed protection requirement. Students discuss whether merging groups, releasing less detail, or answering fewer questions would better fit the educational purpose. The exercise should use synthetic records rather than real learner information because demonstrating noise does not establish a valid production guarantee.
In machine learning, differential privacy can also be applied during training, with methods that limit individual contributions and add noise. Implementation details matter: clipping rules, sampling, numerical behaviour, accounting, and the handling of intermediate data can change the result. A product's claim of differential privacy therefore needs technical documentation and competent review. The NIST guidance emphasizes evaluating the actual guarantee rather than relying on the presence of a privacy-related label.
Differential privacy does not settle every question about educational data. Consent, access control, retention, purpose limitation, group harms, and the consequences of decisions still require attention. It also introduces a practical relationship between privacy and utility that must be assessed for the intended analysis. Educators can ask four useful questions: whose contribution is protected, what is released, how strong is the complete guarantee, and which conclusions remain accurate enough to use? Those questions turn an abstract mathematical protection into an accountable discussion about a particular educational data release.


