Portfolio item number 1
Short description of portfolio item number 1
Posts by Collection
portfolio
Portfolio item number 2
Short description of portfolio item number 2
publications
Machine Translation: Foundations and Models
Published in Arxiv, 2021
This is a book everything you need to know when you start to learning something about NLP. The book was compiled by Professors Tong Xiao and Jingbo Zhu, and I was responsible for the development of the LaTeX code.
Recommended citation:
Download Paper | Download Bibtex
The NiuTrans Machine Translation Systems for WMT20
Published in Workshop, 2022
WMT20 Rank first in Japanese↔English both side.
Recommended citation: Zhang Y, Wang Z, Cao R, et al. The niutrans machine translation systems for wmt20[C]//Proceedings of the Fifth Conference on Machine Translation. 2020: 338-345.
Download Paper
The NiuTrans Machine Translation Systems for WMT22
Published in Workshop, 2022
Our models are based on several advanced Transformer variants, e.g., Transformer-ODE, Universal Multiscale Transformer (UMST). The main workflow consists of data filtering, large-scale data augmentation (i.e., iterative back-translation, iterative knowledge distillation), and specific-domain fine-tuning.
Recommended citation: Zhang Y, Wang Z, Cao R, et al. The niutrans machine translation systems for wmt20[C]//Proceedings of the Fifth Conference on Machine Translation. 2020: 338-345.
Download Paper
A Survey on Conditional Computation
Published in Arxiv, 2023
Survey on research about early exit and mixture of expert.
Recommended citation: Shan W, et al. A Survey on Conditional Computation[J]. 2023.
Download Paper
Early exit is a natural capability in transformer-based models: An empirical study on early exit without joint optimization
Published in Arxiv, 2023
We explore the possibility of LLMs EE without additional output layers and joint optimization.
Recommended citation: Shan W, Meng L, Zheng T, et al. Early exit is a natural capability in transformer-based models: An empirical study on early exit without joint optimization[J]. arXiv preprint arXiv:2412.01455, 2024.
Download Paper
HW-TSC 2024 Submission for the Quality Estimation Shared Task
Published in Workshop, 2024
This paper focuses on Huawei Translation Services Center’s (HW-TSC’s) submission to the sentence-level QE shared task.
Recommended citation: Shan W, Zhu M, Li Y, et al. HW-TSC 2024 Submission for the Quality Estimation Shared Task[C]//Proceedings of the Ninth Conference on Machine Translation. 2024: 535-540.
Download Paper
[Co-author] PartialFormer: Modeling Part Instead of Whole for Machine Translation
Published in ACL 2024 Fingdings, 2024
We introduce PartialFormer, a parameter-efficient Transformer architecture utilizing multiple smaller FFNs to reduce parameters and computation while maintaining essential hidden dimensions.
Recommended citation: Zhang Y, Ma X, Kou K, et al. Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translation[J]. arXiv preprint arXiv:2505.15333, 2025.
Download Paper
Optimizing Speech Multi-View Feature Fusion through Conditional Computation
Published in ICASSP IEEE, 2024
We propose a novel generalized feature fusion framework grounded in conditional computation, mitigates feature conflicts and bolsters model robustness to multi-view input features.
Recommended citation: Shan W, Zhang Y, Han Y, et al. Optimizing Speech Multi-View Feature Fusion through Conditional Computation[C]//ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2025: 1-5.
Download Paper | Download Slides
[Co-author] Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translation
Published in ACL 2025 Fingdings, 2025
We propose the unit language to overcome the two modeling challenges. The unit language can be considered a text-like representation format, constructed using n-gram language modeling.
Recommended citation: Zhang Y, Ma X, Kou K, et al. Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translation[J]. arXiv preprint arXiv:2505.15333, 2025.
Download Paper
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders
Published in EMNLP, 2025
We propose Prompt-aware Mixture (PaM) to enhance the Speech LLM that uses multiple audio encoders.
Recommended citation: **Shan W**, Li Y, Zhang Y, et al. Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders[J]. arXiv preprint arXiv:2502.15178, 2025.
Download Paper | Download Slides
talks
Talk 1 on Relevant Topic in Your Field
发布时间：
This is a description of your talk, which is a markdown file that can be all markdown-ified like any other post. Yay markdown!
Conference Proceeding talk 3 on Relevant Topic in Your Field
发布时间：
This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.
teaching
Teaching experience 1
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Teaching experience 2
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.