fMRI Encoding and Decoding with LLMs: Input Embeddings vs. Hidden State Representations
Comparing input embeddings and hidden states from multiple language model families within both encoding frameworks, which map text features to brain responses, and decoding frameworks, which reconstruct linguistic features from brain activity shows that input embeddings offer a strong and interpretable baseline for rep...