Shiyan Zheng

13 papers A* 1Journal 11Unranked 1
YearRankTypeTitle / Venue / Authors
2026 J jnl
Accelerating grokking through spectral analysis: A multi-method approach to enhancing abstract rule learning in neural networks.
Knowl. Based Syst.
Zhigao Huang, Shiyan Zheng, Miao Pan, Quanfa Li
2026 A* conf
Bot Meets Shortcut: How Can LLMs Aid in Handling Unknown Invariance OOD Scenarios?
AAAI
Shiyan Zheng, Herun Wan, Minnan Luo, Junhang Huang
2026 J jnl
Dynamic spectral weighting in CausalSelfAttention: Enhancing transformer performance through frequency-based head modulation.
Neurocomputing
Zhigao Huang, Musheng Chen, Shiyan Zheng
2026 J jnl
Layer-dependent dynamic spectral weighting for efficient transformer models.
Eng. Appl. Artif. Intell.
Zhigao Huang, Yanzhong Yu, Shiyan Zheng, Musheng Chen, Quanfa Li
2025 J jnl
Bot Meets Shortcut: How Can LLMs Aid in Handling Unknown Invariance OOD Scenarios?
CoRR
Shiyan Zheng, Herun Wan, Minnan Luo, Jun Huang
2025 J jnl
Dynamic Mixture of Experts for Adaptive Computation in Character-Level Transformers.
Inf.
Zhigao Huang, Musheng Chen, Shiyan Zheng
2025 J jnl
Exploring the impact of fixed theta values in RoPE on character-level language model performance and efficiency.
Frontiers Comput. Sci.
Zhigao Huang, Musheng Chen, Shiyan Zheng
2025 J jnl
Restoring Spectral Symmetry in Gradients: A Normalization Approach for Efficient Neural Network Training.
Symmetry
Zhigao Huang, Nana Gong, Quanfa Li, Tianying Wu, Shiyan Zheng, Miao Pan
2025 J jnl
Spectral Adaptive Dropout: Frequency-Based Regularization for Improved Generalization.
Inf.
Zhigao Huang, Musheng Chen, Shiyan Zheng
2025 J jnl
Spectral momentum integration: hybrid optimization of frequency and time domain gradients.
Frontiers Artif. Intell.
Zhigao Huang, Musheng Chen, Shiyan Zheng
2025 J jnl
Transformer spectral optimization: From gradient frequency analysis to adaptive spectral integration.
Appl. Soft Comput.
Zhigao Huang, Musheng Chen, Shiyan Zheng
2024 J jnl
Low-resolution phase shifter-based hybrid precoding for mmWave massive MIMO.
EURASIP J. Wirel. Commun. Netw.
Yipu Yuan, Jung-Lang Yu, Yuzhuo Pan, Shiyan Zheng
2023 — conf
Design and Implementation of Medical Ultrasound Image Processing System based on MATLAB GUI.
ICMIP
Shiyan Zheng, Haohan Zhang, Haixin Zhao, Bowei Zhang, Yu Zhou, Chuang Han