Publications

(# Equal Contribution; * Corresponding Author)

2025

Segment First or Comprehend First? Explore the Limit of Unsupervised Word Segmentation with Large Language Models
Zihong Zhang, Liqi He, Zuchao Li, L Zhang, Hai Zhao, Bo Du

ACL 2025 Oral
Dialogue-RAG: Enhancing Retrieval for LLMs via Node-Linking Utterance Rewriting
Qiwei Li, Teng Xiao, Zuchao Li, Ping Wang, Mengjia Shen, Hai Zhao

ACL 2025, 24423–24438
KV-latent: Dimensional-level KV cache reduction with frequency-aware rotary positional embedding
L Shi, Z Li, L Zhang, G Liu, B Qi, H Zhao

ACL 2025
SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers
Z Tang, S Luohe, Z Li, B Qi, G Liu, L Zhang, P Wang

ACL 2025
IAM: Efficient Inference through Attention Mapping between Different-scale LLMs
Y Zhao, Z Li, H Zhao

ACL 2025
DAC: A Dynamic Attention-aware Approach for Task-Agnostic Prompt Compression
Y Zhao, Z Li, H Zhao, B Qi, G Liu

ACL 2025
Label Drop for Multi-Aspect Relation Modeling in Universal Information Extraction
L Yang, J Li, E Ci, L Zhang, Z Li, P Wang

NAACL 2025
NOTA: Multimodal Music Notation Understanding for Visual Large Language Model
M Tang, J Li, L Yang, Z Zhang, J Tian, Z Li, L Zhang, P Wang

NAACL Findings 2025
Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding
J Hu, Z Li, M Shen, H Ai, S Li, J Zhang

ICCASP 2025
What Limits Bidirectional Model's Generative Capabilities? A Uni-Bi-Directional Mixture-of-Expert Method For Bidirectional Fine-tuning
Z Li, Y Hei, Q Li, L Zhang, P Wang, B Qi, L Guoming

ICML 2025
Imitate Before Detect: Aligning Machine Stylistic Preference for Machine-Revised Text Detection
J Chen, X Zhu, T Liu, Y Chen, X Chen, Y Yuan, CT Leong, Z Li, T Long, ...

AAAI 2025
SongSong: A Time Phonograph for Chinese SongCi Music from Thousand of Years Away
J Hu, J Li, Z Pan, C Chen, Z Li, P Wang, L Zhang

AAAI 2025, 26229–26237

2024

SirLLM: Streaming Infinite Retentive LLM [PDF] [Code]
Yao Yao, Zuchao Li*, and Hai Zhao*

ACL 2024
Hypergraph based Understanding for Document Semantic Entity Recognition [PDF] [Code]
Qiwei Li, Zuchao Li*, Ping Wang, Haojun Ai and Hai Zhao

ACL 2024
Selective Prefix Tuning for Pre-trained Language Models [PDF] [Code]
Hongyi Zhang, Zuchao Li*, Ping Wang, and Hai Zhao

ACL-Findings 2024
The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models [PDF] [Code]
Jiajia Li, Lu Yang, Mingni Tang, Chong Chen, Zuchao Li*, Ping Wang*, and Hai Zhao

ACL-Findings 2024
GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment [PDF] [Code]
Yao Yao, Zuchao Li*, and Hai Zhao*

ACL-Findings 2024
GoT: Effective Graph-of-Thought Reasoning in Language Models [PDF] [Code]
Yao Yao, Zuchao Li*, and Hai Zhao*

NAACL-Findings 2024
Sparse is Enough in Fine-tuning Pre-trained Large Language Models [PDF] [Code]
Weixi Song, Zuchao Li*, Lefei Zhang, Hai Zhao and Bo Du

ICML 2024
Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning [PDF] [Code]
Juncheng Yang, Zuchao Li*, Shuai Xie, Wei Yu, Shijun Li*, Bo Du

LREC-COLING 2024
A Novel Energy based Model Method for Multi-modal Aspect-Based Sentiment Analysis [PDF] [Code]
Tianshuo Peng, Zuchao Li*, Ping Wang, Lefei Zhang, and Hai Zhao

AAAI 2024
Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Models [PDF] [Code]
Liqi He, Zuchao Li*, Xiantao Cai, and Ping Wang

AAAI 2024
N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understanding [PDF] [Code]
Jinhao Tian, Zuchao Li*, Jiajia Li, and Ping Wang*

AAAI 2024

2023

Cross-lingual Universal Dependency Parsing Only From One Monolingual Treebank
Kailai Sun, Zuchao Li*, and Hai Zhao*

T-PAMI 2023
FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction [PDF] [Code]
Tianshuo Peng, Zuchao Li*, Lefei Zhang, Bo Du, and Hai Zhao

ACL 2023
Learning Event-aware Measures for Event Coreference Resolution [PDF]
Yao Yao, Zuchao Li*, and Hai Zhao*

ACL-Findings 2023
Contextualized Semantic Distance between Highly Overlapped Texts [PDF] [Code]
Letian Peng, Zuchao Li*, and Hai Zhao*

ACL-Findings 2023
Enhancing Ancient Chinese Understanding with Derived Noisy Syntax Trees [PDF]
Shitou Zhang, Ping Wang*, Zuchao Li*, and Jingrui Hou

ACL Workshop 2023
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers [PDF] [Code]
Yineng Chen, Zuchao Li*, Lefei Zhang, Bo Du, and Hai Zhao

ICML 2023
Enhancing Visually-Rich Document Understanding via Layout Structure Modeling [PDF] [Code]
Qiwei Li, Zuchao Li*, Xiantao Cai, Bo Du, and Hai Zhao

MM 2023
MAPLE: Semi-Supervised Learning with Multi-Alignment and Pseudo-Learning [PDF] [Code]
Juncheng Yang, Chao Li, Zuchao Li*, Wei Yu, Bo Du, and Shijun Li*

KDD 2023
Fine-grained Position Helps Memorizing More, A Novel Music Compound Transformer Model with Feature Interaction Fusion [PDF] [Code]
Zuchao Li, Ruhang Gong, Yineng Chen, and Kehua Su*

AAAI 2023
iRe^2F: Rethinking Effective Refinement in Language Structure Prediction via Efficient Iterative Retrospecting and Reasoning [PDF]
Zuchao Li, Xingyi Guo, Letian Peng, Lefei Zhang, and Hai Zhao*

IJCAI 2023

2022

What Works and Doesn't Work, A Deep Decoder for Neural Machine Translation [PDF]
Zuchao Li, Yiran Wang, Masao Utiyama, Eiichiro Sumita, Hai Zhao, and Taro Watanabe

ACL-Findings 2022
Restricted or Not: A General Training Framework for Neural Machine Translation [PDF]
Zuchao Li, Masao Utiyama, Eiichiro Sumita, and Hai Zhao

ACL Workshop 2022
Reorder and then Parse, Fast and Accurate Discontinuous Constituency Parsing [PDF]
Kailai Sun, Zuchao Li*, Hai Zhao*

EMNLP 2022
Nested Named Entity Recognition as Corpus Aware Holistic Structure Parsing [PDF]
Yifei Yang#, Zuchao Li#, Hai Zhao

COLING 2022
BiBL: AMR Parsing and Generation with Bidirectional Bayesian Learning [PDF] [Code]
Ziming Cheng, Zuchao Li* and Hai Zhao*

COLING 2022
Explicit Alignment Learning for Neural Machine Translation [PDF]
Zuchao Li, Hai Zhao*, Fengshun Xiao, Masao Utiyama and Eiichiro Sumita

IJCAI 2022
Incorporating Rich Syntax Information in Grammatical Error Correction [PDF]
Zuchao Li, Kevin Parnow, Hai Zhao

IPM 2022
Neural Character-level Syntactic Parsing for Chinese [PDF]
Zuchao Li, Junru Zhou, Hai Zhao, Zhisong Zhang, Haonan Li, Yuqi Ju

JAIR 2022
Dependency and Span, Cross-Style Semantic Role Labeling on PropBank and NomBank [PDF]
Zuchao Li, Hai Zhao, Junru Zhou, Kevin Parnow, and Shexia He

TALLIP 2022

2021

Text Compression-aided Transformer Encoding [PDF]
Zuchao Li, Zhuosheng Zhang, Hai Zhao, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita

T-PAMI 2021
Syntax Role for Neural Semantic Role Labeling [PDF]
Zuchao Li, Hai Zhao, Shexia He, Jiaxun Cai

CL 2021
Grammatical Error Correction as GAN-like Sequence Labeling [PDF]
Kevin Parnow#, Zuchao Li#, Hai Zhao*

ACL-Findings 2021
Multilingual Pre-training with Universal Dependency Learning [PDF] [Code]
Kailai Sun*, Zuchao Li* and Hai Zhao

NeurIPS 2021
Unsupervised Neural Machine Translation with Universal Grammar [PDF]
Zuchao Li, Masao Utiyama, Eiichiro Sumita, Hai Zhao

EMNLP 2021
HPSG-inspired Joint Neural Constituent and Dependency Parsing in O (n^3) Time Complexity [PDF]
Zuchao Li, Junru Zhou, Hai Zhao, and Kevin Parnow

TASLP 2021
Tri-training for Dependency Parsing Domain Adaptation [PDF]
Shujiang#, Zuchao Li#, Hai Zhao*, Baoliang Lu, and Rui Wang

TALLIP 2021

2020

Data-dependent Gaussian Prior Objective for Language Generation [PDF] [Code]
Zuchao Li, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Zhuosheng Zhang, and Hai Zhao

ICLR 2020 (Long Talk)
High-order Semantic Role Labeling [PDF] [Code]
Zuchao Li, Hai Zhao, Rui Wang, and Kevin Parnow

EMNLP-Findings 2020
Reference Language based Unsupervised Neural Machine Translation [PDF] [Code]
Zuchao Li, Hai Zhao, Rui Wang, Masao Utiyama and Eiichiro Sumita

EMNLP-Findings 2020
Global Greedy Dependency Parsing [PDF] [Code]
Zuchao Li, Hai Zhao, Kevin Parnow

AAAI 2020
Explicit Sentence Compression for Neural Machine Translation [PDF] [Code]
Zuchao Li, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Zhuosheng Zhang, and Hai Zhao

AAAI 2020
Memory Network for Linguistic Structure Parsing [PDF]
Zuchao Li, Chaoyu Guan, Hai Zhao, Rui Wang, Kevin Parnow, Zhuosheng Zhang

TASLP 2020

2019

Syntax-aware Multilingual Semantic Role Labeling [PDF] [Code]
Shexia He#, Zuchao Li#, Hai Zhao*

EMNLP-IJCNLP 2019
Dependency or Span, End-to-End Uniform Semantic Role Labeling
Zuchao Li, Shexia He, Hai Zhao, Yiqing Zhang, Zhuosheng Zhang, Xi Zhou, Xiang Zhou

AAAI 2019
Cross-Domain Transfer Learning for Dependency Parsing [PDF]
Zuchao Li, Junru Zhou, Hai Zhao

NLPCC 2019
Effective Representation for Easy-First Dependency Parsing [PDF]
Zuchao Li, Jiaxun Cai, Hai Zhao

PRICAI 2019

2018

Syntax for Semantic Role Labeling, to Be, or Not to Be [PDF]
Shexia He#, Zuchao Li#, Hai Zhao*, Hongxiao Bai, Gongshen Liu

ACL 2018
A Unified Syntax-aware Framework for Semantic Role Labeling
Zuchao Li, Shexia He, Jiaxun Cai, Zhuosheng Zhang, Hai Zhao, Gongshen Liu, Linlin Li, and Luo Si

EMNLP 2018
Seq2seq Dependency Parsing
Zuchao Li, Jiaxun Cai, Shexia He and Hai Zhao

COLING 2018