Author

Poulami Ghosh

h-index 1 View on Semantic Scholar

We have 1 of 3 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Jul 2026

Language Models are not Equally Robust to Non-Canonical Tokenization across Languages

The study of tokenization robustness serves as a diagnostic of how tightly a model is coupled to its tokenizer, and demonstrates that tokenization robustness is not a universal property of language models, but depends strongly on the language and its interaction with the tokenizer.

Poulami Ghosh, P. Jyothi · 0 citations