Zuchao Li

(Photo taken on March 2022)

Zuchao Li (Charlie) 李祖超
Associate Researcher
School of Computer Science
Wuhan University


Room E306, School of Computer Science Building
Wuhan University, Wuhan 430072, China


Email: zcli.charlie AT gmail DOT com 
Homepage: https://zcli-charlie.github.io/

[Google Scholar] [Github]



Biography

I am now a Associate Researcher at Wuhan University. I got my PhD degree from Department of Computer Science and Technology, Shanghai Jiao Tong University, advised by Prof. Hai Zhao. I have visited National Institute of Information and Communications Technology (NICT) as Limited Technical Researcher, Japan, hosted by Doc. Masao Utiyama and Doc. Eiichiro Sumita.

My research interests including the language sequence modeling, linguistic structure parsing, and language representation learning from various types of data (unlabeled or noisy data, structured data like tree, graph, etc.). Specifically, I focus on theoretical and algorithmic approaches for syntax/semantic parsing, self-supervised/weakly supervised learning, structure learning, and related NLP tasks.


I am actively recruiting master/PhD students and undergraduate interns! Welcome to contact me with your detailed CV in advance!

I also welcome students from outside the School of Computer Science (or outside of Wuhan University) to join the research group, and will arrange appropriate research/development assignments based on your background.

Research Fields / Working Projects


Selected Publications

Equal  Contribution;  Corresponding  Author; [Full List])

  1. SirLLM: Streaming Infinite Retentive LLM [PDF] [Code]
    Yao Yao, Zuchao Li*, and Hai Zhao*
    the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024), 2024

  2. Hypergraph based Understanding for Document Semantic Entity Recognition [PDF] [Code]
    Qiwei Li, Zuchao Li*, Ping Wang, Haojun Ai and Hai Zhao
    the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024), 2024

  3. Selective Prefix Tuning for Pre-trained Language Models [PDF] [Code]
    Hongyi Zhang, Zuchao Li*, Ping Wang, and Hai Zhao
    the 62nd Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2024), 2024

  4. The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models [PDF] [Code]
    Jiajia Li, Lu Yang, Mingni Tang, Chong Chen, Zuchao Li*, Ping Wang*, and Hai Zhao
    the 62nd Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2024), 2024

  5. GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment [PDF] [Code]
    Yao Yao, Zuchao Li*, and Hai Zhao*
    the 62nd Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2024), 2024

  6. GoT: Effective Graph-of-Thought Reasoning in Language Models [PDF] [Code]
    Yao Yao, Zuchao Li*, and Hai Zhao*
    Annual Conference of the North American Chapter of the Association for Computational Linguistics, Findings (NAACL-Findings 2024), 2024

  7. Sparse is Enough in Fine-tuning Pre-trained Large Language Models [PDF] [Code]
    Weixi Song, Zuchao Li*, Lefei Zhang, Hai Zhao and Bo Du
    International Conference on Machine Learning (ICML 2024), 2024

  8. Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning [PDF] [Code]
    Juncheng Yang, Zuchao Li*, Shuai Xie, Wei Yu, Shijun Li*, Bo Du
    the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), 2024

  9. A Novel Energy based Model Method for Multi-modal Aspect-Based Sentiment Analysis [PDF] [Code]
    Tianshuo Peng, Zuchao Li*, Ping Wang, Lefei Zhang, and Hai Zhao
    AAAI Conference on Artificial Intelligence (AAAI 2024), 2024

  10. Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Models [PDF] [Code]
    Liqi He, Zuchao Li*, Xiantao Cai, and Ping Wang
    AAAI Conference on Artificial Intelligence (AAAI 2024), 2024

  11. N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understanding [PDF] [Code]
    Jinhao Tian, Zuchao Li*, Jiajia Li, and Ping Wang*
    AAAI Conference on Artificial Intelligence (AAAI 2024), 2024


  12. Cross-lingual Universal Dependency Parsing Only From One Monolingual Treebank [PDF]
    Kailai Sun, Zuchao Li*, and Hai Zhao*
    IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI 2023), 2023

  13. FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction [PDF] [Code]
    Tianshuo Peng, Zuchao Li*, Lefei Zhang, Bo Du, and Hai Zhao
    Annual Meeting of the Association for Computational Linguistics (ACL 2023), 2023

  14. Learning Event-aware Measures for Event Coreference Resolution [PDF]
    Yao Yao, Zuchao Li*, and Hai Zhao*
    Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2023), 2023

  15. Contextualized Semantic Distance between Highly Overlapped Texts [PDF] [Code]
    Letian Peng, Zuchao Li*, and Hai Zhao*
    Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2023), 2023

  16. Enhancing Ancient Chinese Understanding with Derived Noisy Syntax Trees [PDF]
    Shitou Zhang, Ping Wang*, Zuchao Li*, and Jingrui Hou
    Annual Meeting of the Association for Computational Linguistics, Student Research Workshop (ACL Workshop 2023), 2023

  17. Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers [PDF] [Code]
    Yineng Chen, Zuchao Li*, Lefei Zhang, Bo Du, and Hai Zhao
    International Conference on Machine Learning (ICML 2023), 2023

  18. Enhancing Visually-Rich Document Understanding via Layout Structure Modeling [PDF] [Code]
    Qiwei Li, Zuchao Li*, Xiantao Cai, Bo Du, and Hai Zhao
    the 31st ACM International Conference on Multimedia (MM 2023), 2023

  19. MAPLE: Semi-Supervised Learning with Multi-Alignment and Pseudo-Learning [PDF] [Code]
    Juncheng Yang, Chao Li, Zuchao Li*, Wei Yu, Bo Du, and Shijun Li*
    the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2023), 2023

  20. Fine-grained Position Helps Memorizing More, A Novel Music Compound Transformer Model with Feature Interaction Fusion [PDF] [Code]
    Zuchao Li, Ruhang Gong, Yineng Chen, and Kehua Su*
    AAAI Conference on Artificial Intelligence (AAAI 2023), 2023

  21. iRe^2F: Rethinking Effective Refinement in Language Structure Prediction via Efficient Iterative Retrospecting and Reasoning [PDF]
    Zuchao Li, Xingyi Guo, Letian Peng, Lefei Zhang, and Hai Zhao*
    International Joint Conference on Artificial Intelligence (IJCAI 2023), 2023


  22. What Works and Doesn't Work, A Deep Decoder for Neural Machine Translation [PDF]
    Zuchao Li, Yiran Wang, Masao Utiyama, Eiichiro Sumita, Hai Zhao, and Taro Watanabe.
    Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2022), 2022 

  23. Restricted or Not: A General Training Framework for Neural Machine Translation [PDF]
    Zuchao Li, Masao Utiyama, Eiichiro Sumita, and Hai Zhao
    Annual Meeting of the Association for Computational Linguistics, Student Research Workshop (ACL Workshop 2022), 2022 

  24. Reorder and then Parse, Fast and Accurate Discontinuous Constituency Parsing [PDF]
    Kailai Sun, Zuchao Li*, Hai Zhao*
    Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), 2022

  25. Nested Named Entity Recognition as Corpus Aware Holistic Structure Parsing [PDF]
    Yifei Yang#, Zuchao Li#, Hai Zhao
    International Conference on Computational Linguistics (COLING 2022), 2022

  26. BiBL: AMR Parsing and Generation with Bidirectional Bayesian Learning [PDF] [Code]
    Ziming Cheng, Zuchao Li* and Hai Zhao*
    International Conference on Computational Linguistics (COLING 2022), 2022

  27. Explicit Alignment Learning for Neural Machine Translation [PDF]
    Zuchao Li, Hai Zhao*, Fengshun Xiao, Masao Utiyama and Eiichiro Sumita
    International Joint Conference on Artificial Intelligence (IJCAI 2022), 2022

  28. Incorporating Rich Syntax Information in Grammatical Error Correction [PDF]
    Zuchao Li, Kevin Parnow, Hai Zhao
    Information Processing and Management (IPM 2022), 2022

  29. Neural Character-level Syntactic Parsing for Chinese [PDF]
    Zuchao Li, Junru Zhou, Hai Zhao, Zhisong Zhang, Haonan Li, Yuqi Ju
    Journal of Artificial Intelligence Research (JAIR 2022), 2022

  30. Dependency and Span, Cross-Style Semantic Role Labeling on PropBank and NomBank [PDF]
    Zuchao Li, Hai Zhao, Junru Zhou, Kevin Parnow, and Shexia He
    ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP 2022), 2022


  31. Text Compression-aided Transformer Encoding [PDF]
    Zuchao Li, Zhuosheng Zhang, Hai Zhao, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita
    IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI 2021), 2021

  32. Syntax Role for Neural Semantic Role Labeling [PDF]
    Zuchao Li, Hai Zhao, Shexia He, Jiaxun Cai
    Computational Linguistics (CL 2021), 2021

  33. Grammatical Error Correction as GAN-like Sequence Labeling [PDF]
    Kevin Parnow#, Zuchao Li#, Hai Zhao*
    Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2021), 2021 

  34. Multilingual Pre-training with Universal Dependency Learning [PDF] [Code]
    Kailai Sun*, Zuchao Li* and Hai Zhao
    Neural Information Processing Systems (NeurIPS 2021), 2021

  35. Unsupervised Neural Machine Translation with Universal Grammar [PDF]
    Zuchao Li, Masao Utiyama, Eiichiro Sumita, Hai Zhao
    Conference on Empirical Methods in Natural Language Processing (EMNLP 2021), 2021

  36. HPSG-inspired Joint Neural Constituent and Dependency Parsing in O (n^3) Time Complexity [PDF]
    Zuchao Li, Junru Zhou, Hai Zhao, and Kevin Parnow
    IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP 2021), 2021

  37. Tri-training for Dependency Parsing Domain Adaptation [PDF]
    Shujiang#, Zuchao Li#, Hai Zhao*, Baoliang Lu, and Rui Wang
    ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP 2021), 2021


  38. Data-dependent Gaussian Prior Objective for Language Generation [PDF] [Code]
    Zuchao Li, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Zhuosheng Zhang, and Hai Zhao
    International Conference on Learning Representations (ICLR 2020), 2020 (Long Talk, Full Review Score, Top 1%)

  39. High-order Semantic Role Labeling [PDF] [Code]
    Zuchao Li, Hai Zhao, Rui Wang, and Kevin Parnow
    Conference on Empirical Methods in Natural Language Processing, Findings (EMNLP-Findings 2020), 2020 

  40. Reference Language based Unsupervised Neural Machine Translation [PDF] [Code]
    Zuchao Li, Hai Zhao, Rui Wang, Masao Utiyama and Eiichiro Sumita
    Conference on Empirical Methods in Natural Language Processing, Findings (EMNLP-Findings 2020), 2020 

  41. Global Greedy Dependency Parsing [PDF] [Code]
    Zuchao Li, Hai Zhao, Kevin Parnow
    AAAI Conference on Artificial Intelligence (AAAI 2020), 2020

  42. Explicit Sentence Compression for Neural Machine Translation [PDF] [Code]
    Zuchao Li, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Zhuosheng Zhang, and Hai Zhao
    AAAI Conference on Artificial Intelligence (AAAI 2020), 2020

  43. Memory Network for Linguistic Structure Parsing [PDF]
    Zuchao Li, Chaoyu Guan, Hai Zhao, Rui Wang, Kevin Parnow, Zhuosheng Zhang
    IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP 2020), 2020


  44. Syntax-aware Multilingual Semantic Role Labeling [PDF] [Code]
    Shexia He#, Zuchao Li#, Hai Zhao*
    Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP 2019), 2019

  45. Dependency or Span, End-to-End Uniform Semantic Role Labeling [PDF] [Code]
    Zuchao Li, Shexia He, Hai Zhao, Yiqing Zhang, Zhuosheng Zhang, Xi Zhou, Xiang Zhou
    AAAI Conference on Artificial Intelligence (AAAI 2019), 2019

  46. Cross-Domain Transfer Learning for Dependency Parsing [PDF]
    Zuchao Li, Junru Zhou, Hai Zhao
    CCF International Conference on Natural Language Processing and Chinese Computing (NLPCC 2019), 2019

  47. Effective Representation for Easy-First Dependency Parsing [PDF]
    Zuchao Li, Jiaxun Cai, Hai Zhao
    Pacific Rim International Conference on Artificial Intelligence (PRICAI 2019), 2019


  48. Syntax for Semantic Role Labeling, to Be, or Not to Be [PDF]
    Shexia He#, Zuchao Li#, Hai Zhao*, Hongxiao Bai, Gongshen Liu
    Annual Meeting of the Association for Computational Linguistics (ACL 2018), 2018

  49. A Unified Syntax-aware Framework for Semantic Role Labeling [PDF] [Code]
    Zuchao Li, Shexia He, Jiaxun Cai, Zhuosheng Zhang, Hai Zhao, Gongshen Liu, Linlin Li, and Luo Si
    Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), 2018

  50. Seq2seq Dependency Parsing [PDF] [Code]
    Zuchao Li, Jiaxun Cai, Shexia He and Hai Zhao
    International Conference on Computational Linguistics (COLING 2018), 2018


Academic Service


Awards


Student Advising