I am Heejun Lee. I am an undergraduate student at the KAIST School of Computing. Hello, World! 🐱

My research interest includes:

  • Efficient AI Models and Frameworks
  • Large-scale Machine Learning System Design, Develop, and Serving
  • Neural Network Compression and Computation Optimization

🔥 News

  • 2024.06.10: I made the homepage!

📝 Publications

SEA: Sparse Linear Attention with Estimated Attention Mask

[paper][code] Heejun Lee, Jina Kim, Jeffrey Willette, Sung Ju Hwang. ICLR 2024


Sparse Token Transformer with Attention Back Tracking

[paper][code] Heejun Lee, Minki Kang, Youngwan Lee, Sung Ju Hwang. ICLR 2023


(*: equal contribution)

🎖 Honors and Awards

  • 23’F KAIST College of Engineering Leadership Award on Research Excellence
  • 22’F KAIST College of Engineering Leadership Award on Research Excellence
  • 22’S KAIST College of Engineering Dean’s List
  • 18’ Intel International Science and Engineering Fair Finalist & 4th Grand Award in Robotics and Intelligent Machines
  • 18’ 제 9회 한국청소년과학창의대회(ISEF-K) 1등 (1st Place)
  • 17’ 제 34회 한국정보올림피아드(Korea Olympiad in Informatics; KOI) 공모부분 금상 (Gold Medal; 2nd Place)
  • 16’ 제 33회 한국정보올림피아드(Korea Olympiad in Informatics; KOI) 공모부분 금상 (Gold Medal; 2nd Place)

📖 Educations

  • Korea Advanced Institute of Science and Technology (KAIST) Mar. 2020 - Aug. 2024 (Expected) B.S. in Computer Science

Experiences

  • KAIST MLAI. Oct 2022 -. Undergraduate Internship; Jul 2021 - Oct 2022. Undergraduate Individual Research
  • DeepAuto.ai. Jan 2023 - May 2023. Research Engineer
  • Transverse. Oct 2020 - Mar 2021. AI Lead Developer