Kwanhee Lee

bassist_kwan.JPG

Hi, I’m a second-year Master’s student at Graduate School of Artificial Intelligence, POSTECH, where I’m fortunate to be advised by Prof. Namhoon Lee. Previously, I was an Academic Visitor in DASLab at ISTA, hosted by Prof. Dan Alistarh.

My goal is to make foundation models more efficient through the lens of optimization. Broadly, my research interests lie in 1. Optimization-based model compression (pruning, quantization, distillation), 2. Systematic optimization for efficient model inference (writing CUDA kernels, profiling/optimizing inference systems–vLLM), and 3. Optimization for deep learning (Muon/shampoo/soap and it’s friends!).

For more details, please take a look at my CV

news

Oct 16, 2026 Successfully defended my Master’s thesis! 🎓
Oct 11, 2026 Selected as a Top Reviewer for NeurIPS 2026!
Sep 29, 2026 New preprint on hardware-native joint sparse-quantization for trillion-scale MoEs! Code and models are released.
Aug 23, 2026 Our paper on canonical elements for extreme LLM sparsity has been accepted to EMNLP 2026 (main conference)!
Aug 07, 2026 Our new paper on canonical elements for extreme LLM sparsity won the Best Paper Award at CKAIA 2026! Preprint will be released soon on arXiv.

selected publications

  1. Hardware-Native Joint Sparse-Quantization for Trillion-Scale Mixture-of-Experts
    Kwanhee Lee, Namhoon Lee, and Dan Alistarh
    arXiv preprint, 2026
  2. hidden_plain_sight.png
    Hidden in Plain Sight: The Overlooked Significance of Canonical Elements for Extreme LLM Sparsity
    Hyeondo Jang, Kwanhee Lee, Dongyeop Lee, and 1 more author
    In EMNLP, 2026
    Main conference | CKAIA 2026 Best Paper Award
  3. unseen_frontier.png
    The Unseen Frontier: Pushing the Limits of LLM Sparsity with Surrogate-Free ADMM
    Kwanhee Lee, Hyeondo Jang, Dongyeop Lee, and 2 more authors
    In ICLR, 2026
    JKAIA 2025 Best Paper Award
  4. safe.png
    SAFE: Finding Sparse and Flat Minima to Improve Pruning
    Dongyeop Lee, Kwanhee Lee, Jinseok Chung, and 1 more author
    In ICML, 2025
    Spotlight(top 2.6%) poster | 2025 POSTECH-GSAI BK21 Best Paper Award
  5. dynamic.jpg
    Dynamic Network Compression via Probabilistic Channel Pruning
    Kwanhee Lee, and Hyang-Won Lee
    Neural Networks, 2026