Across verifiable reasoning, open-ended generation, and post-SFT settings, RRPO remains competitive with verifier-based optimization, improves over weakly supervised baselines, and provides additional gains after supervised fine-tuning.
This empirical study investigates whether procedural LLM skills can be represented as directions in activation space and whether vector-space operations over these directions can express skill-level behaviors and finds that procedural skills admit a vector-space representation.
Xun-Yi Jiang, Jun-Da Wu, Yuxin Xiong et al.· 0 citations
This work treats each reasoning trace as a sequence of latent states rather than an unstructured texts, and investigates whether inference time interventions can provide fine-grained control over the self-looping reasoning process.
The first MuseCP evaluation framework is introduced that covers four categories of music facets with fine-grained and well-tailored metrics to capture nuanced changes in music attributes and hopes it can offer practical guidance for developing more effective and reliable music editing strategies with strong MuseCP capa...
Yash Vishe, Eric Xue, Xunyi Jiang et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.