Hoyeon Chang

Pronunciation: [hojʌn tɕɑŋ]

Ph.D. Student

Graduate School of AI, KAIST

Hello, I am a Ph.D. student in Language & Knowledge Lab at KAIST Graduate School of AI. I am fortunate to be advised by Minjoon Seo. Before KAIST, I obtained a B.S. in Electrical & Computer Engineering, and Biological Sciences at Seoul National University.

My academic goal is to understand the acquisition and processing of knowledge by intelligent systems from complex patterns. Specifically, my recent focus lies in analyzing language models to understand how they encode, transfer, and utilize knowledge for reasoning and inference. I am open and passionate about studying and integrating concepts from other fields involved in studying intelligence and knowledge (computational neuroscience, complex systems, philosophy, linguistics, psychology, etc.) to deepen my understanding of intelligent systems.

You can contact me via e-mail: retapurayo@kaist.ac.kr

Education

• Korea Advanced Institute of Science and Technology, Feb 2024 - Present

  Ph.D. in Artificial Intelligence

• Korea Advanced Institute of Science and Technology, Sep 2022 - Feb 2024

  M.S. in Artificial Intelligence

• Seoul National University, Mar 2018 - Aug 2022

  B.S. in Biological Sciences and Electrical & Computer Engineering, Summa cum laude

• Korea Science Academy of KAIST, Mar 2015 - Feb 2018

Research Experience

• Research Intern at KAIST LK Lab, Feb 2022 - Aug 2022 (Advisor: Minjoon Seo)

• Research Intern at SNU LDI Lab, Sep 2021 - Jan 2022 (Advisor: Seungwon Hwang)

• Research Intern at SNU CHANGlab, Dec 2020 - Feb 2021 (Advisor: Hyeshik Chang)

• SNU Undergraduate Research Program, May 2020 - Dec 2020 (Advisor: Young-Jae Seok)

Publications

2024

• How Do Large Language Models Acquire Factual Knowledge During Pretraining?, NeurIPS 2024

  Hoyeon Chang, Jinho Park, Seonghyeon Ye, Sohee Yang, Youngkyung Seo, Du-Seong Chang, Minjoon Seo

2023

• Nonparametric Decoding for Generative Retrieval, ACL 2023 Findings

  Hyunji Lee, Jaeyoung Kim, Hoyeon Chang, Hanseok Oh, Sohee Yang, Vlad Karpukhin, Yi Lu, Minjoon Seo

Awards

• SNU Undergraduate Research Program Outstanding Research Award, 2021
• Hyoungae Scholarship, 2019 - 2021
• Zayed Future Energy Prize in global high schools(Asia) category, 2016

Languages

• Native in Korean
• Fluent in English(TOEIC 925/990) and Japanese(JLPT N1 164/180)
• Beginner in German and Spanish