Representation of syntax in LLMs through the lens of linear distance and similarity-aware entropy
Two factors are identified that predict most of UASL's variability across relations: the mean and dispersion of the linear distance between the related words, and the diversity of the diversity of the syntactic relation's head.
Juan Pablo Vigneaux, Mary Kennedy, Khalil Iskarous et al.
· 0 citations