(Photo taken on March 2022)

Zuchao Li (Charlie) 李祖超 Associate Researcher School of Computer Science Wuhan University Room E306, School of Computer Science Building Wuhan University, Wuhan 430072, China Email: zcli.charlie AT gmail DOT com  Homepage: https://zcli-charlie.github.io/ [Google Scholar] [Github]

---

Biography

I am now a Associate Researcher at Wuhan University. I got my PhD degree from Department of Computer Science and Technology, Shanghai Jiao Tong University, advised by Prof. Hai Zhao. I have visited National Institute of Information and Communications Technology (NICT) as Limited Technical Researcher, Japan, hosted by Doc. Masao Utiyama and Doc. Eiichiro Sumita.

My research interests including the language sequence modeling, linguistic structure parsing, and language representation learning from various types of data (unlabeled or noisy data, structured data like tree, graph, etc.). Specifically, I focus on theoretical and algorithmic approaches for syntax/semantic parsing, self-supervised/weakly supervised learning, structure learning, and related NLP tasks.

---

I am actively recruiting master/PhD students and undergraduate interns! Welcome to contact me with your detailed CV in advance!

I also welcome students from outside the School of Computer Science (or outside of Wuhan University) to join the research group, and will arrange appropriate research/development assignments based on your background.

---

Research Fields / Working Projects

1. Large Language Model (LLM) Pre-training (BatGPT)

2. Low-resource Syntax / Semantic Parsing

3. Alignment Improved Representation Learning

4. Better Optimization During Model Fintune

5. Better Inference Framework

---

Selected Publications

( # Equal  Contribution;  * Corresponding  Author; [Full List])

A Novel Energy based Model Method for Multi-modal Aspect-Based Sentiment Analysis [PDF] Tianshuo Peng, Zuchao Li*, Ping Wang, Lefei Zhang, and Hai Zhao AAAI Conference on Artificial Intelligence (AAAI 2024), 2024 Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Models [PDF] Liqi He, Zuchao Li*, Xiantao Cai, and Ping Wang AAAI Conference on Artificial Intelligence (AAAI 2024), 2024 N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understanding [PDF] Jinhao Tian, Zuchao Li*, Jiajia Li, and Ping Wang* AAAI Conference on Artificial Intelligence (AAAI 2024), 2024 Cross-lingual Universal Dependency Parsing Only From One Monolingual Treebank [PDF] Kailai Sun, Zuchao Li*, and Hai Zhao* IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI 2023), 2023 Enhancing Visually-Rich Document Understanding via Layout Structure Modeling [PDF] Qiwei Li, Zuchao Li*, Xiantao Cai, Bo Du, and Hai Zhao the 31st ACM International Conference on Multimedia (MM 2023), 2023 MAPLE: Semi-Supervised Learning with Multi-Alignment and Pseudo-Learning [PDF] Juncheng Yang, Chao Li, Zuchao Li*, Wei Yu, Bo Du, and Shijun Li* the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2023), 2023 FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction [PDF] Tianshuo Peng, Zuchao Li*, Lefei Zhang, Bo Du, and Hai Zhao Annual Meeting of the Association for Computational Linguistics (ACL 2023), 2023 Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers [PDF] Yineng Chen, Zuchao Li*, Lefei Zhang, Bo Du, and Hai Zhao International Conference on Machine Learning (ICML 2023), 2023 iRe^2F: Rethinking Effective Refinement in Language Structure Prediction via Efficient Iterative Retrospecting and Reasoning [PDF] Zuchao Li, Xingyi Guo, Letian Peng, Lefei Zhang, and Hai Zhao* International Joint Conference on Artificial Intelligence (IJCAI 2023), 2023 Fine-grained Position Helps Memorizing More, A Novel Music Compound Transformer Model with Feature Interaction Fusion [PDF] Zuchao Li, Ruhang Gong, Yineng Chen, and Kehua Su* AAAI Conference on Artificial Intelligence (AAAI 2023), 2023 Explicit Alignment Learning for Neural Machine Translation [PDF] Zuchao Li, Hai Zhao*, Fengshun Xiao, Masao Utiyama and Eiichiro Sumita International Joint Conference on Artificial Intelligence (IJCAI 2022), 2022 Text Compression-aided Transformer Encoding [PDF] Zuchao Li, Zhuosheng Zhang, Hai Zhao, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI 2021), 2021 Multilingual Pre-training with Universal Dependency Learning [PDF] Kailai Sun*, Zuchao Li* and Hai Zhao Neural Information Processing Systems (NeurIPS 2021), 2021 Data-dependent Gaussian Prior Objective for Language Generation [PDF] [Code] Zuchao Li, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Zhuosheng Zhang, and Hai Zhao International Conference on Learning Representations (ICLR 2020), 2020 (Long Talk, Full Review Score, Top 1%) Global Greedy Dependency Parsing [PDF] [Code] Zuchao Li, Hai Zhao, Kevin Parnow AAAI Conference on Artificial Intelligence (AAAI 2020), 2020 Explicit Sentence Compression for Neural Machine Translation [PDF] [Code] Zuchao Li, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Zhuosheng Zhang, and Hai Zhao AAAI Conference on Artificial Intelligence (AAAI 2020), 2020 Dependency or Span, End-to-End Uniform Semantic Role Labeling [PDF] [Code] Zuchao Li, Shexia He, Hai Zhao, Yiqing Zhang, Zhuosheng Zhang, Xi Zhou, Xiang Zhou AAAI Conference on Artificial Intelligence (AAAI 2019), 2019 Syntax for Semantic Role Labeling, to Be, or Not to Be [PDF] Shexia He#, Zuchao Li#, Hai Zhao*, Hongxiao Bai, Gongshen Liu Annual Meeting of the Association for Computational Linguistics (ACL 2018), 2018 Reorder and then Parse, Fast and Accurate Discontinuous Constituency Parsing [PDF] [Code] Kailai Sun, Zuchao Li*, Hai Zhao* Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), 2022 Nested Named Entity Recognition as Corpus Aware Holistic Structure Parsing [PDF] [Code] Yifei Yang#, Zuchao Li#, Hai Zhao International Conference on Computational Linguistics (COLING 2022), 2022 BiBL: AMR Parsing and Generation with Bidirectional Bayesian Learning [PDF] [Code] Ziming Cheng, Zuchao Li* and Hai Zhao* International Conference on Computational Linguistics (COLING 2022), 2022 Incorporating Rich Syntax Information in Grammatical Error Correction [PDF] [Code] Zuchao Li, Kevin Parnow, Hai Zhao Information Processing and Management (IPM 2022), 2022 Neural Character-level Syntactic Parsing for Chinese [PDF] [Code] Zuchao Li, Junru Zhou, Hai Zhao, Zhisong Zhang, Haonan Li, Yuqi Ju Journal of Artificial Intelligence Research (JAIR 2022), 2022 HPSG-inspired Joint Neural Constituent and Dependency Parsing in O (n^3) Time Complexity [PDF] [Code] Zuchao Li, Junru Zhou, Hai Zhao, and Kevin Parnow IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP 2021), 2021 Syntax Role for Neural Semantic Role Labeling [PDF] [Code] Zuchao Li, Hai Zhao, Shexia He, Jiaxun Cai Computational Linguistics (CL 2021), 2021 Unsupervised Neural Machine Translation with Universal Grammar [PDF] Zuchao Li, Masao Utiyama, Eiichiro Sumita, Hai Zhao Conference on Empirical Methods in Natural Language Processing (EMNLP 2021), 2021 Memory Network for Linguistic Structure Parsing [PDF] [Code] Zuchao Li, Chaoyu Guan, Hai Zhao, Rui Wang, Kevin Parnow, Zhuosheng Zhang IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP 2020), 2020 A Unified Syntax-aware Framework for Semantic Role Labeling [PDF] [Code] Zuchao Li, Shexia He, Jiaxun Cai, Zhuosheng Zhang, Hai Zhao, Gongshen Liu, Linlin Li, and Luo Si Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), 2018 Seq2seq Dependency Parsing [PDF] [Code] Zuchao Li, Jiaxun Cai, Shexia He and Hai Zhao International Conference on Computational Linguistics (COLING 2018), 2018 Syntax-aware Multilingual Semantic Role Labeling [PDF] [Code] Shexia He#, Zuchao Li#, Hai Zhao* Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP 2019), 2019 Dependency and Span, Cross-Style Semantic Role Labeling on PropBank and NomBank [PDF] [Code] Zuchao Li, Hai Zhao, Junru Zhou, Kevin Parnow, and Shexia He ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP 2022), 2022 Cross-Domain Transfer Learning for Dependency Parsing [PDF] [Code] Zuchao Li, Junru Zhou, Hai Zhao CCF International Conference on Natural Language Processing and Chinese Computing (NLPCC 2019), 2019 Effective Representation for Easy-First Dependency Parsing [PDF] [Code] Zuchao Li, Jiaxun Cai, Hai Zhao Pacific Rim International Conference on Artificial Intelligence (PRICAI 2019), 2019 Tri-training for Dependency Parsing Domain Adaptation [PDF] [Code] Shujiang#, Zuchao Li#, Hai Zhao*, Baoliang Lu, and Rui Wang ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP 2021), 2021 Restricted or Not: A General Training Framework for Neural Machine Translation [PDF] Zuchao Li, Masao Utiyama, Eiichiro Sumita, and Hai Zhao Annual Meeting of the Association for Computational Linguistics, Student Research Workshop (ACL Workshop 2022), 2022  What Works and Doesn't Work, A Deep Decoder for Neural Machine Translation [PDF] Zuchao Li, Yiran Wang, Masao Utiyama, Eiichiro Sumita, Hai Zhao, and Taro Watanabe. Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2022), 2022  High-order Semantic Role Labeling [PDF] [Code] Zuchao Li, Hai Zhao, Rui Wang, and Kevin Parnow Conference on Empirical Methods in Natural Language Processing, Findings (EMNLP-Findings 2020), 2020  Reference Language based Unsupervised Neural Machine Translation [PDF] Zuchao Li, Hai Zhao, Rui Wang, Masao Utiyama and Eiichiro Sumita Conference on Empirical Methods in Natural Language Processing, Findings (EMNLP-Finds 2020), 2020  Grammatical Error Correction as GAN-like Sequence Labeling [PDF] Kevin Parnow#, Zuchao Li#, Hai Zhao* Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics, Findings (ACL-Findings 2021), 2021

---

Academic Service

• Journal Reviewer: TASLP, TALLIP, TCBB, etc.
• Conference Program Committee: NeurIPS, ICML, ICLR, ACL, EMNLP, AAAI, IJCAI, NLPCC, CCL, etc.

---

Awards

• Top 100 Chinese Rising Stars in Artificial Intelligence, Baidu Scholarship 
• SJTU Outstanding Ph.D. Scholarship, 85th CSE Education and Development Fund & Yang Yuanqing Education Fund

---

Student Advising

• Jinhao Tian (WHU master Student, 2023)
• Qiwei Li (WHU master Student, 2023)
• Jiliang Hu (WHU master Student, 2023)
• Ziyi Pan (WHU master Student, 2023)
• Tianshuo Peng (WHU undergraduate Student, 2022)
• Liqi He (WHU undergraduate Student, 2022)
• Ruhan Gong (WHU master Student, 2022)
• Yineng Chen (WHU undergraduate Student, 2022)
• Xin Yan (WHU undergraduate Student, 2022)
• Shitou Zhang (WHU undergraduate Student → MS Student at HKUST, 2022)
• Letian Peng (co-supervised with Prof. Hai Zhao. SJTU Undergraduate Student, 2021 → PhD Student at UCSD, 2022)
• Kailai Sun (co-supervised with Prof. Hai Zhao. SJTU Undergraduate Student, 2020 → MS Student at SJTU, 2022)
• Yifei Yang (co-supervised with Prof. Hai Zhao. CSU Undergraduate Student, 2020 → PhD Student at SJTU, 2021)
• Yao Yao (co-supervised with Prof. Hai Zhao. SEU Undergraduate Student, 2021 → PhD Student at SJTU, 2022)
• Ziming Cheng (co-supervised with Prof. Hai Zhao. SJTU MS Student, 2022)