NeedToKnow
A benchmark for inference channels in fine-tuned language models
Organizations fine-tune language models on internal documents and restrict what each user may see. A fine-tuned model can combine facts from different documents, so a user may obtain a restricted fact that no document they may read states. NeedToKnow measures whether access controls withhold these derived facts as reliably as stated ones.