Is Memorization Context-Sensitive? Prefix-Based Extraction Beyond Isolated Prefixes
It is found that context does not simply erase memorization, and many samples that are extractable without context remain extractable under the retrieved context, especially as the prefix length increases.