Author

Hoshik Kim

h-index 3 View on Semantic Scholar

We have 3 of 16 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

NELSSA: A GPU-PNM Heterogeneous System for Mixed-Length LLM Serving via Length-based Request Placement

NELSSA is presented, an LLM serving system that integrates GPUs with real-world Processing-near-Memory accelerator devices to efficiently support mixed-length workloads and improves decode throughput by up to 5.5x in tokens/sec and reduces P99 latency by up to 15x compared to GPU-only baselines.

Sookyung Choi, Seungyong Lee, Kangkyu Park et al. · arXiv.org · 0 citations

Preprint Jul 2026

A CXL Memory Rack for Multi-Turn LLM Serving

This paper presents HyMCache, a CXL memory rack for multi-turn LLM serving using cost-efficient CXL-hybrid memory, which combines a small amount of in-device DRAM with large SSD-backed capacity behind a CXL interface to efficiently support TB-scale SSD-backed KV reuse.

Hakbeom Jang, Inho Song, Hoshik Kim et al. · 0 citations

Preprint Jul 2026

StreamDQ: Near-Memory Weight DeQuantization in Custom HBM for Scalable AI Inference Acceleration

StreamDQ is proposed, a lightweight architectural enhancement that enables on-the-fly dequantization in the memory subsystem for high-throughput, large-batch LLM inference and reduces latency and improves decode throughput for end-to-end LLM inference.

Minki Jeong, Daegun Yoon, Soohong Ahn et al. · 0 citations