Hyunmin Choi

CASYS Lab, KAIST

profile.jpg

E3-1, KAIST, Daejeon, South Korea

hmchoi@casys.kaist.ac.kr

About Me

I am Senior master student in School of Computing at KAIST.

Research Interests

  • LLM Inference Serving System Acceleration & Optimization
  • Distributed & Large Scale System
  • LLM accelerators (especially NPU, PIM)

Education

2020.03 - 2024.08 : Undergraduate in School of Computing, KAIST

2024.09 - Present : Master program in School of Computing, KAIST

Experiences

  • 2022.8 - 2024.8 : Undergraduate Student Intern, CASYS Lab (Prof. Jongse Park)
  • 2024.2 - 2024.6 : KAIST Undergraduate Research Program (advisor : Prof. Jongse Park)

Publication

LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
Jaehong Cho, Minsu Kim, Hyunmin Choi, Guseul Heo, Jongse Park
IISWC, 2024 Paper (Best Paper Award & Distinguished Artifact Award)

LLMServingSim: A Simulation Infrastructure for LLM Inference Serving Systems
Jaehong Cho, Minsu Kim, Hyunmin Choi, Jongse Park
ISCA Workshop on ML for Computer Architecture and Systems (MLArchSys), 2024 Paper

NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing
Guseul Heo, Sangyeop Lee, Jaehong Cho, Hyunmin Choi, Sanghyeon Lee, Hyungkyu Ham, Gwangsun Kim, Divya Mahajan, Jongse Park
ASPLOS, 2024 Paper

selected publications