Seonghyeon Ye

Publications

---

2024

• Latent Action Pretraining from Videos
  Seonghyeon Ye^*, Joel Jang^*, Byeongguk Jeon, Sejune Joo, Jianwei Yang, Baolin Peng, Ajay Mandlekar, Reuben Tan, Yu-Wei Chao, Bill Yuchen Lin, Lars Liden, Kimin Lee, Jianfeng Gao, Luke Zettlemoyer, Dieter Fox, Minjoon Seo
  Arxiv 2024
  [paper] [code] [website]

• How Do Large Language Models Acquire Factual Knowledge During Pretraining?
  Hoyeon Chang, Jinho Park, Seonghyeon Ye, Sohee Yang, Youngkyung Seo, Du-Seong Chang, Minjoon Seo
  NeurIPS 2024
  [paper] [code]

• Instruction Matters, a Simple yet Effective Task Selection Approach in Instruction Tuning for Specific Tasks
  Changho Lee, Janghoon Han, Seonghyeon Ye, Stanley Jungkyu Choi, Honglak Lee, Kyunghoon Bae
  EMNLP 2024
  [paper] [code]

• Self-Explore to Avoid the Pit: Improving the Reasoning Capabilities of Language Models with Fine-grained Rewards
  Hyeonbin Hwang, Doyoung Kim, Seungone Kim, Seonghyeon Ye, Minjoon Seo
  EMNLP 2024 Findings
  [paper] [code]

• FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  Seonghyeon Ye^*, Doyoung Kim^*, Sungdong Kim, Hyeonbin Hwang, Seungone Kim, Yongrae Jo, James Thorne, Juho Kim, Minjoon Seo
  ICLR 2024 Spotlight
  [paper] [code]

• Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis
  Sohee Yang, Jonghyeon Kim, Joel Jang, Seonghyeon Ye, Hyunji Lee, Minjoon Seo
  TACL 2024
  [paper] [code]

• Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  Seonghyeon Ye, Hyeonbin Hwang, Sohee Yang, Hyeongu Yun, Yireun Kim, Minjoon Seo
  AAAI 2024
  [paper] [code]

• Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Models
  Yujin Kim, Jaehong Yoon, Seonghyeon Ye, Sung Ju Hwang, Se-young Yun
  NAACL 2024
  [paper]

---

2023

• The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-tuning
  Seungone Kim, Se June Joo, Doyoung Kim, Joel Jang, Seonghyeon Ye, Jamin Shin, Minjoon Seo
  EMNLP 2023
  [paper] [code]

• Efficiently Enhancing Zero-Shot Performance of Instruction Following Model via Retrieval of Soft Prompt
  Seonghyeon Ye, Joel Jang, Doyoung Kim, Yongrae Jo, Minjoon Seo
  EMNLP 2023 Findings
  [paper] [code]

• Exploring the Benefits of Training Expert Language Models over Instruction Tuning
  Joel Jang, Seungone Kim, Seonghyeon Ye, Doyoung Kim, Lajanugen Logeswaran, Moontae Lee, Kyungjae Lee, Minjoon Seo
  ICML 2023
  [paper] [code]

• Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  Seonghyeon Ye, Doyoung Kim, Joel Jang, Joongbo Shin, Minjoon Seo
  ICLR 2023
  [paper] [code]

• SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation
  Seonghyeon Ye^*, Yongrae Jo^*, Doyoung Kim^*, Sungdong Kim, Hyeonbin Hwang, Minjoon Seo
  Blog post
  [blog] [code]

---

2022

• Can Large Language Models Truly Understand Prompts? A Case Study with Negated Prompts
  Joel Jang^*, Seonghyeon Ye^*, Minjoon Seo
  Transfer Learning for NLP Workshop @ NeurIPS 2022
  [paper] [code]

• TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
  Joel Jang^*, Seonghyeon Ye^*, Chango Lee, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, Minjoon Seo
  EMNLP 2022
  [paper] [code]

• Towards Continual Knowledge Learning of Language Models
  Joel Jang, Seonghyeon Ye, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, Stanley Jungkyu Choi, Minjoon Seo
  ICLR 2022
  [paper] [code]

---

2021

• Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning
  Seonghyeon Ye, Jiseon Kim, Alice Oh
  EMNLP 2021 (short)
  [paper] [code]

• Dimensional Emotion Detection from Categorical Emotion
  Sungjoon Park, Jiseon Kim, Seonghyeon Ye, Jaeyeol Jeon, Hee Young Park, Alice Oh
  EMNLP 2021
  [paper] [code]