Hi, I’m Hyunjong Ok 😀

I’m a second-year Ph.D. student in GSAI (Graduate School of Artificial Intelligence) at POSTECH Efficient Learning Lab (EffL), advised by Prof. Jaeho Lee. Before joining POSTECH, I completed my B.S. degree in software convergence from KyungHee University (KHU).

My main research interest lies in multimodal learning, utilizing various modalities (such as images, text, and audio)
I am also interested in inference-efficient research and audio-related tasks (especially music)

Publications 📜

(* means ‘equal contribution’)

AudioBERT: Audio Knowledge Augmented Language Model
Hyunjong Ok*, Suho Yoo*, Jaeho Lee
ICASSP, 2025

Decoding with Limited Teacher Supervision Requires Understanding When to Trust the Teacher
Hyunjong Ok, Jegwang Ryu, Jaeho Lee
EMNLP, 2024

SCANNER: Knowledge-Enhanced Approach for Robust Multi-modal Named Entity Recognition of Unseen Entities
Hyunjong Ok, Taeho Kil, Sukmin Seo, Jaeho Lee
NAACL, 2024

FinTree: Financial Dataset Pretrain Transformer Encoder for Relation Extraction
Hyunjong Ok
SIGIR Workshop on Knowledge Discovery from Unstructured Data in Financial Services, 2023

POST-TRAINED LANGUAGE MODEL ADAPTIVE TO EXTRACTIVE SUMMARIZATION OF LONG SPOKEN DOCUMENTS
Hyunjong Ok, Seong-Bae Park
ICASSP Grand Challenge, 2023

Under review

Speculative End-Turn Detector for Efficient Speech Chatbot Assistant
Hyunjong Ok, Suho Yoo, Jaeho Lee
preprint 25.03

Imagine to Hear: Auditory Knowledge Generation can be an Effective Assistant for Language Models
Suho Yoo*, Hyunjong Ok*, Jaeho Lee
preprint 25.03

S2Cap: A Benchmark and a Baseline for Singing Style Captioning
Hyunjong Ok, Jaeho Lee
preprint 24.09

Experience 🏢

AI Intern, Naver CLOUD, Mar 2023 ~ Sep 2023

Undergraduate Researcher, NLP Lab, KyungHee University, Mar 2022 ~ Feb 2023

Data Engineer Intern, Ingkle, Nov 2021 ~ Feb 2022

Award 🏆

Korean AI Challenge: ASR track (1ST PLACE: KOREA MINISTER’S AWARD)
Ministry of Science and ICT, Oct 2022

KLAID legal judgment prediction challenge: Text classification (1ST PLACE)
Law & Company, Dec 2022

Genome EC number classification AI challenge (2ND PLACE)
Infoboss, Dec 2022

Sentence type classification AI challenge (4TH PLACE)
Sungkyunkwan University, Dec 2022

ICASSP 2023 MUG GRAND CHALLENGE 2ND TRACK (1ST PLACE)
Alibaba DAMO Academy , Feb 2023

SIGIR 2023 KDF WORKSHOP SHARED TASK (2ND PLACE)
J.P. Morgan AI Research, Jun 2023

Korean AI challenge: ASR track (4TH PLACE)
Ministry of Science and ICT, Nov 2023

National defense AI challenge (4TH PLACE)
Ministry of National Defense, Dec 2023

JKAIA (OUTSTANDING PAPER AWARD)
Korean Artificial Intelligence Association, Nov 2024

Kaggle Competitions

KORE 2022 (BRONZE MEDAL), 2022 Jul

FEEDBACK PRIZE - EVALUATING STUDENT WRITING (SILVER MEDAL), 2022 Mar

COMMONLIT - EVALUATE STUDENT SUMMARIES (SILVER MEDAL), 2023 Oct