Skip to content

Author

Sun-Woo Lee

We have 4 of 33 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Ghosted Layers: Unconstrained Activation Alignment for Recovering Layer-Pruned LLMs

This paper derives a closed-form optimal linear operator from a small calibration set to reconstruct the activation discrepancy introduced by the pruned layers, and shows that this solution corresponds to the unconstrained optimum of the alignment objective, whereas LinearPatch is restricted to a fixed basis symmetric...

Vincent-Daniel Yun, Junhyuk Jo, Sai Praneeth Karimireddy et al. · 3 citations
#machine learning Preprint Oct 2026

Latent Information Sharing for Accelerating Federated Learning

Federated learning (FL) is a communication-efficient distributed learning paradigm. However, client drift remains one of the most critical challenges, hindering the efficient training of a global model. In this study, we propose a novel latent information sharing scheme that directly mitigates data heterogeneity across...

Seung-Jun Lee, Ensieh Khazaei, Dimitrios Hatzinakos et al. · 1 citation
#machine learning Preprint Sep 2026

ReSCENE: Server-Side Replay for Structural Mitigation of Catastrophic Forgetting in Federated Continual Learning

Federated continual learning must integrate new tasks over time without losing earlier-task knowledge. Most existing methods attach an anti-forgetting mechanism to the client-trained, server-aggregated loop of federated learning, which holds back new learning to preserve earlier knowledge and burdens resource-constrain...

Sung-Min Kang, Zheng-Zhong Tu, Sun-Woo Lee · 0 citations
#artificial intelligence Preprint Aug 2026

Output-Aware Rotation for INT2 KV-Cache Quantization

OptR is proposed, an output-aware rotation method that minimizes post-W_O$ attention-output error and applies an attention-equivalent key reparameterization to reduce large channel-wise offsets without changing the softmax distribution.

Vincent-Daniel Yun, Woo-Sang Lim, Minsoo Cheong et al. · 2 citations · ⚡1

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.