Anjulika Salhan

Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometry

Analysis of the pre-trained embedding geometry of a small sentence transformer (SBERT) and classic SLM reveals that pre-trained embedding geometry is associated with classification performance and reveals a counterintuitive finding that a structured input that would help a human reader does not improve the SLM performance.