Research Brief

Distill to Detect (D2D) is a novel method that exposes hidden preferential biases in large language models by amplifying subtle distributional shifts into detectable text output using a KV-cache prefix adapter.

Language models deployed in critical roles can harbor subtle, hidden biases that favor specific entities or viewpoints, potentially influencing users at scale. These 'stealth biases' are particularly dangerous because they manifest only on relevant topics, remaining invisible to standard text-based inspection, and prior work has shown they can transfer even through unrelated data, residing purely in the model's soft logit distribution. The core challenge for defenders is an asymmetry: without knowing the specific bias topic, current detection methods are ineffective. This paper introduces Distill to Detect (D2D), a method designed to overcome this by distilling the hidden distributional shift between a suspect model and its unbiased base into a 'cartridge' (a KV-cache prefix adapter). This process concentrates the dominant divergence, amplifying the subtle bias signal directly into the model's generated text, making it reliably detectable. The paper also provides a theoretical framework, based on Fisher-weighted projection of the logit distribution shift, to explain D2D's effectiveness, transforming the inherent capacity bottleneck of prefix-tuning into a valuable auditing tool for deployed LLMs.

• Auditing and compliance for large language models to ensure fairness and prevent manipulative AI behaviors in high-stakes applications.
• Developing regulatory frameworks and tools for identifying and mitigating undisclosed biases in commercial AI systems.
• Enhancing responsible AI development practices by providing a method for internal bias detection before model deployment.
• Consumer protection against models that might subtly steer decisions, recommendations, or information access in a biased manner.