The Instruction Tax on Factual Recall: Base Models Can Beat Their Instruction-Tuned Counterparts
It is shown that the prompting methodology is as important as the model architecture: while the instruction-tuned model version achieves 0.5681 with its chat interface, the base model achieves 0.6836 when prompted using text completion, which decreases factual recall.
Christophe Khalil, Aya Mourad
· 0 citations