Zhi-Qin John Xu

94 papers A* 6Journal 82Unranked 5

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers. IEEE Trans. Pattern Anal. Mach. Intell. Zhongwang Zhang, Pengxiao Lin, Zhiwei Wang, Yaoyu Zhang, Zhi-Qin John Xu
2026	J	`jnl`	Towards Understanding Adam Convergence on Highly Degenerate Polynomials. CoRR Zhiwei Bai, Jiajie Zhao, Zhangchen Zhou, Zhi-Qin John Xu, Yaoyu Zhang
2025	J	`jnl`	Achilles' Heel of Mamba: Essential difficulties of the Mamba architecture demonstrated by synthetic data. CoRR Tianyi Chen, Pengxiao Lin, Zhiwei Wang, Zhi-Qin John Xu
2025	J	`jnl`	Adaptive Preconditioners Trigger Loss Spikes in Adam. CoRR Zhiwei Bai, Zhangchen Zhou, Jiajie Zhao, Xiaolong Li, Zhiyu Li, Feiyu Xiong, Hongkang Yang, Yaoyu Zhang, Zhi-Qin John Xu
2025	—	`conf`	An Advanced nnU-Net Framework for BraTS-2025 PED. BraTS-Lighthouse/AIMS-TBI@MICCAI (1) Xiaolong Li, Zhi-Qin John Xu, Yan Ren, Tianming Qiu, Xiaowen Wang
2025	A*	`conf`	An Analysis for Reasoning Bias of Language Models with Small Initialization. ICML Junjie Yao, Zhongwang Zhang, Zhi-Qin John Xu
2025	J	`jnl`	An Analysis for Reasoning Bias of Language Models with Small Initialization. CoRR Junjie Yao, Zhongwang Zhang, Zhi-Qin John Xu
2025	J	`jnl`	An overview of condensation phenomenon in deep learning. CoRR Zhi-Qin John Xu, Yaoyu Zhang, Zhangchen Zhou
2025	J	`jnl`	Bayesian Inversion with Neural Operator (BINO) for modeling subdiffusion: Forward and inverse problems. J. Comput. Appl. Math. Xiong-Bin Yan, Zhi-Qin John Xu, Zheng Ma
2025	J	`jnl`	Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers. CoRR Zhongwang Zhang, Pengxiao Lin, Zhiwei Wang, Yaoyu Zhang, Zhi-Qin John Xu
2025	—	`conf`	Frequency-Aware Ensemble Learning for BraTS 2025 Pediatric Brain Tumor Segmentation. BraTS-Lighthouse/AIMS-TBI@MICCAI (1) Yuxiao Yi, Qingyao Zhuang, Zhi-Qin John Xu, Xiaowen Wang, Yan Ren, Tianming Qiu
2025	J	`jnl`	Frequency-Aware Ensemble Learning for BraTS 2025 Pediatric Brain Tumor Segmentation. CoRR Yuxiao Yi, Qingyao Zhuang, Zhi-Qin John Xu
2025	J	`jnl`	Identity Bridge: Enabling Implicit Reasoning via Shared Latent Memory. CoRR Pengxiao Lin, Zhengan Chen, Zhi-Qin John Xu
2025	J	`jnl`	Input gradient annealing neural network for solving Fokker-Planck equations with low temperature. J. Comput. Phys. Liangkai Hang, Dan Hu, Zhi-Qin John Xu
2025	J	`jnl`	Limit Analysis for Symbolic Multi-step Reasoning Tasks with Information Propagation Rules Based on Transformers. CoRR Tian Qin, Yuhan Chen, Zhiwei Wang, Zhi-Qin John Xu
2025	J	`jnl`	MemOS: A Memory OS for AI System. CoRR Zhiyu Li, Shichao Song, Chenyang Xi, Hanyu Wang, Chen Tang, Simin Niu, Ding Chen, Jiawei Yang, Chunyu Li, Qingchen Yu, Jihao Zhao, Yezhaohui Wang, Peng Liu, Zehao Lin, Pengyuan Wang, Jiahao Huo, Tianyi Chen, Kai Chen, Kehang Li, Zhen Tao, Junpeng Ren, Huayi Lai, Hao Wu, Bo Tang, Zhenren Wang, Zhaoxin Fan, Ningyu Zhang, Linfeng Zhang, Junchi Yan, Mingchuan Yang, Tong Xu, Wei Xu, Huajun Chen, Haofeng Wang, Hongkang Yang, Wentao Zhang, Zhi-Qin John Xu, Siheng Chen, Feiyu Xiong
2025	J	`jnl`	MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models. CoRR Zhiyu Li, Shichao Song, Hanyu Wang, Simin Niu, Ding Chen, Jiawei Yang, Chenyang Xi, Huayi Lai, Jihao Zhao, Yezhaohui Wang, Junpeng Ren, Zehao Lin, Jiahao Huo, Tianyi Chen, Kai Chen, Kehang Li, Zhiqiang Yin, Qingchen Yu, Bo Tang, Hongkang Yang, Zhi-Qin John Xu, Feiyu Xiong
2025	J	`jnl`	Neural Network Based Framework for Passive Intermodulation Cancellation in MIMO Systems. CoRR Xiaolong Li, Zhi-Qin John Xu, Peiting You, Yifei Zhu
2025	J	`jnl`	On understanding and overcoming spectral biases of deep neural network learning methods for solving PDEs. CoRR Zhi-Qin John Xu, Lulu Zhang, Wei Cai
2025	J	`jnl`	On understanding and overcoming spectral biases of deep neural network learning methods for solving PDEs. J. Comput. Phys. Zhi-Qin John Xu, Lulu Zhang, Wei Cai
2025	J	`jnl`	Probability Signature: Bridging Data Semantics and Embedding Structure in Language Models. CoRR Junjie Yao, Zhi-Qin John Xu
2025	J	`jnl`	Reasoning Bias of Next Token Prediction Training. CoRR Pengxiao Lin, Zhongwang Zhang, Zhi-Qin John Xu
2025	J	`jnl`	Scalable Complexity Control Facilitates Reasoning Ability of LLMs. CoRR Liangkai Hang, Junjie Yao, Zhiwei Bai, Tianyi Chen, Yang Chen, Rongjie Diao, Hezhou Li, Pengxiao Lin, Zhiwei Wang, Cheng Xu, Zhongwang Zhang, Zhangchen Zhou, Zhiyu Li, Zehao Lin, Kai Chen, Feiyu Xiong, Yaoyu Zhang, Weinan E, Hongkang Yang, Zhi-Qin John Xu
2025	J	`jnl`	Solving multiscale dynamical systems by deep learning. Comput. Phys. Commun. Junjie Yao, Yuxiao Yi, Liangkai Hang, Weinan E, Weizong Wang, Yaoyu Zhang, Tianhan Zhang, Zhi-Qin John Xu
2025	J	`jnl`	Towards Reliable Pediatric Brain Tumor Segmentation: Task-Specific nnU-Net Enhancements. CoRR Xiaolong Li, Zhi-Qin John Xu, Yan Ren, Tianming Qiu, Xiaowen Wang
2025	—	`conf`	Understanding the Language Model to Solve the Symbolic Multi-Step Reasoning Problem from the Perspective of Buffer Mechanism. EMNLP (Findings) Zhiwei Wang, Yunji Wang, Zhongwang Zhang, Zhangchen Zhou, Hui Jin, Tianyang Hu, Jiacheng Sun, Zhenguo Li, Yaoyu Zhang, Zhi-Qin John Xu
2024	J	`jnl`	A rationale from frequency perspective for grokking in training neural network. CoRR Zhangchen Zhou, Yaoyu Zhang, Zhi-Qin John Xu
2024	J	`jnl`	Anchor function: a type of benchmark functions for studying language models. CoRR Zhongwang Zhang, Zhiwei Wang, Junjie Yao, Zhangchen Zhou, Xiaolong Li, Weinan E, Zhi-Qin John Xu
2024	J	`jnl`	Efficient and Flexible Method for Reducing Moderate-Size Deep Neural Networks with Condensation. Entropy Tianyi Chen, Zhi-Qin John Xu
2024	J	`jnl`	Efficient and Flexible Method for Reducing Moderate-size Deep Neural Networks with Condensation. CoRR Tianyi Chen, Zhi-Qin John Xu
2024	J	`jnl`	Implicit Regularization of Dropout. IEEE Trans. Pattern Anal. Mach. Intell. Zhongwang Zhang, Zhi-Qin John Xu
2024	J	`jnl`	Initialization is Critical to Whether Transformers Fit Composite Functions by Inference or Memorizing. CoRR Zhongwang Zhang, Pengxiao Lin, Zhiwei Wang, Yaoyu Zhang, Zhi-Qin John Xu
2024	A*	`conf`	Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing. NeurIPS Zhongwang Zhang, Pengxiao Lin, Zhiwei Wang, Yaoyu Zhang, Zhi-Qin John Xu
2024	J	`jnl`	Loss Jump During Loss Switch in Solving PDEs with Neural Networks. CoRR Zhiwei Wang, Lulu Zhang, Zhongwang Zhang, Zhi-Qin John Xu
2024	J	`jnl`	Solving multiscale dynamical systems by deep learning. CoRR Zhi-Qin John Xu, Junjie Yao, Yuxiao Yi, Liangkai Hang, Weinan E, Yaoyu Zhang, Tianhan Zhang
2024	A*	`conf`	Stochastic Modified Equations and Dynamics of Dropout Algorithm. ICLR Zhongwang Zhang, Yuqing Li, Tao Luo, Zhi-Qin John Xu
2024	J	`jnl`	Towards Understanding How Transformer Perform Multi-step Reasoning with Matching Operation. CoRR Zhiwei Wang, Yunji Wang, Zhongwang Zhang, Zhangchen Zhou, Hui Jin, Tianyang Hu, Jiacheng Sun, Zhenguo Li, Yaoyu Zhang, Zhi-Qin John Xu
2024	J	`jnl`	Understanding Time Series Anomaly State Detection through One-Class Classification. CoRR Hanxu Zhou, Yuan Zhang, Guangjie Leng, Ruofan Wang, Zhi-Qin John Xu
2023	J	`jnl`	An Unsupervised Deep Learning Approach for the Wave Equation Inverse Problem. CoRR Xiong-Bin Yan, Keke Wu, Zhi-Qin John Xu, Zheng Ma
2023	J	`jnl`	Laplace-fPINNs: Laplace-based fractional physics-informed neural networks for solving forward and inverse problems of subdiffusion. CoRR Xiong-Bin Yan, Zhi-Qin John Xu, Zheng Ma
2023	J	`jnl`	Limitation of Characterizing Implicit Regularization by Data-independent Functions. Trans. Mach. Learn. Res. Leyang Zhang, Zhi-Qin John Xu, Tao Luo, Yaoyu Zhang
2023	J	`jnl`	Loss Spike in Training Neural Networks. CoRR Zhongwang Zhang, Zhi-Qin John Xu
2023	J	`jnl`	Optimistic Estimate Uncovers the Potential of Nonlinear Models. CoRR Yaoyu Zhang, Zhongwang Zhang, Leyang Zhang, Zhiwei Bai, Tao Luo, Zhi-Qin John Xu
2023	J	`jnl`	Phase Diagram of Initial Condensation for Two-layer Neural Networks. CoRR Zhengan Chen, Yuqing Li, Tao Luo, Zhangchen Zhou, Zhi-Qin John Xu
2023	J	`jnl`	Solving a class of multi-scale elliptic PDEs by means of Fourier-based mixed physics informed neural networks. CoRR Xi'an Li, Jinran Wu, Zhi-Qin John Xu, You-Gan Wang
2023	J	`jnl`	Stochastic Modified Equations and Dynamics of Dropout Algorithm. CoRR Zhongwang Zhang, Yuqing Li, Tao Luo, Zhi-Qin John Xu
2023	J	`jnl`	Subspace decomposition based DNN algorithm for elliptic type multi-scale PDEs. J. Comput. Phys. Xi-An Li, Zhi-Qin John Xu, Lei Zhang
2023	J	`jnl`	Understanding the Initial Condensation of Convolutional Neural Networks. CoRR Zhangchen Zhou, Hanxu Zhou, Yuqing Li, Zhi-Qin John Xu
2022	J	`jnl`	A deep learning-based model reduction (DeePMR) method for simplifying chemical kinetics. CoRR Zhiwei Wang, Yaoyu Zhang, Yiguang Ju, Weinan E, Zhi-Qin John Xu, Tianhan Zhang
2022	J	`jnl`	A multi-scale sampling method for accurate and robust deep neural network to predict combustion chemical kinetics. CoRR Tianhan Zhang, Yuxiao Yi, Yifan Xu, Zhi X. Chen, Yaoyu Zhang, Weinan E, Zhi-Qin John Xu
2022	J	`jnl`	A regularised deep matrix factorised model of matrix completion for image restoration. IET Image Process. Zhemin Li, Zhi-Qin John Xu, Tao Luo, Hongxia Wang
2022	J	`jnl`	An Experimental Comparison Between Temporal Difference and Residual Gradient with Neural Network Approximation. CoRR Shuyu Yin, Tao Luo, Peilin Liu, Zhi-Qin John Xu
2022	J	`jnl`	Bayesian Inversion with Neural Operator (BINO) for Modeling Subdiffusion: Forward and Inverse Problems. CoRR Xiong-Bin Yan, Zhi-Qin John Xu, Zheng Ma
2022	J	`jnl`	Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks. CoRR Zhiwei Bai, Tao Luo, Zhi-Qin John Xu, Yaoyu Zhang
2022	A*	`conf`	Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width. NeurIPS Hanxu Zhou, Qixuan Zhou, Zhenyuan Jin, Tao Luo, Yaoyu Zhang, Zhi-Qin John Xu
2022	J	`jnl`	Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width. CoRR Hanxu Zhou, Qixuan Zhou, Zhenyuan Jin, Tao Luo, Yaoyu Zhang, Zhi-Qin John Xu
2022	J	`jnl`	Implicit regularization of dropout. CoRR Zhongwang Zhang, Zhi-Qin John Xu
2022	J	`jnl`	Limitation of characterizing implicit regularization by data-independent functions. CoRR Leyang Zhang, Zhi-Qin John Xu, Tao Luo, Yaoyu Zhang
2022	J	`jnl`	Linear Stability Hypothesis and Rank Stratification for Nonlinear Models. CoRR Yaoyu Zhang, Zhongwang Zhang, Leyang Zhang, Zhiwei Bai, Tao Luo, Zhi-Qin John Xu
2022	—	`ed.`	Mathematical and Scientific Machine Learning, 15-17 August 2022, Peking University, Beijing, China MSML Bin Dong, Qianxiao Li, Lei Wang, Zhi-Qin John Xu
2022	J	`jnl`	On the Exact Computation of Linear Frequency Principle Dynamics and Its Generalization. SIAM J. Math. Data Sci. Tao Luo, Zheng Ma, Zhi-Qin John Xu, Yaoyu Zhang
2022	J	`jnl`	Overview frequency principle/spectral bias in deep learning. CoRR Zhi-Qin John Xu, Yaoyu Zhang, Tao Luo
2022	A*	`conf`	Towards Understanding the Condensation of Neural Networks at Initial Training. NeurIPS Hanxu Zhou, Qixuan Zhou, Tao Luo, Yaoyu Zhang, Zhi-Qin John Xu
2021	J	`jnl`	A variance principle explains why dropout finds flatter minima. CoRR Zhongwang Zhang, Hanxu Zhou, Zhi-Qin John Xu
2021	J	`jnl`	An Upper Limit of Decaying Rate with Respect to Frequency in Deep Neural Network. CoRR Tao Luo, Zheng Ma, Zhiwei Wang, Zhi-Qin John Xu, Yaoyu Zhang
2021	J	`jnl`	Data-informed Deep Optimization. CoRR Lulu Zhang, Zhi-Qin John Xu, Yaoyu Zhang
2021	A*	`conf`	Embedding Principle of Loss Landscape of Deep Neural Networks. NeurIPS Yaoyu Zhang, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu
2021	J	`jnl`	Embedding Principle of Loss Landscape of Deep Neural Networks. CoRR Yaoyu Zhang, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu
2021	J	`jnl`	Embedding Principle: a hierarchical structure of loss landscape of deep neural networks. CoRR Yaoyu Zhang, Yuqing Li, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu
2021	J	`jnl`	Force-in-domain GAN inversion. CoRR Guangjie Leng, Yekun Zhu, Zhi-Qin John Xu
2021	J	`jnl`	Frequency Principle in Deep Learning Beyond Gradient-descent-based Training. CoRR Yuheng Ma, Zhi-Qin John Xu, Jiwei Zhang
2021	J	`jnl`	Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networks. CoRR Yaoyu Zhang, Tao Luo, Zheng Ma, Zhi-Qin John Xu
2021	J	`jnl`	MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEs. CoRR Lulu Zhang, Tao Luo, Yaoyu Zhang, Zhi-Qin John Xu, Zheng Ma
2021	J	`jnl`	Phase Diagram for Two-layer ReLU Neural Networks at Infinite-width Limit. J. Mach. Learn. Res. Tao Luo, Zhi-Qin John Xu, Zheng Ma, Yaoyu Zhang
2021	J	`jnl`	Subspace Decomposition based DNN algorithm for elliptic type multi-scale PDEs. CoRR Xi-An Li, Zhi-Qin John Xu, Lei Zhang
2021	J	`jnl`	Towards Understanding the Condensation of Two-layer Neural Networks at Initial Training. CoRR Zhi-Qin John Xu, Hanxu Zhou, Tao Luo, Yaoyu Zhang
2020	J	`jnl`	A regularized deep matrix factorized model of matrix completion for image restoration. CoRR Zhemin Li, Zhi-Qin John Xu, Tao Luo, Hongxia Wang
2020	—	`conf`	A type of generalization error induced by initialization in deep neural networks. MSML Yaoyu Zhang, Zhi-Qin John Xu, Tao Luo, Zheng Ma
2020	J	`jnl`	Deep frequency principle towards understanding why deeper learning is faster. CoRR Zhi-Qin John Xu, Hanxu Zhou
2020	J	`jnl`	Fourier-domain Variational Formulation and Its Well-posedness for Supervised Learning. CoRR Tao Luo, Zheng Ma, Zhiwei Wang, Zhi-Qin John Xu, Yaoyu Zhang
2020	J	`jnl`	Implicit bias with Ritz-Galerkin method in understanding deep learning for solving PDEs. CoRR Jihong Wang, Zhi-Qin John Xu, Jiwei Zhang, Yaoyu Zhang
2020	J	`jnl`	Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains. CoRR Ziqi Liu, Wei Cai, Zhi-Qin John Xu
2020	J	`jnl`	On the exact computation of linear frequency principle dynamics and its generalization. CoRR Tao Luo, Zheng Ma, Zhi-Qin John Xu, Yaoyu Zhang
2020	J	`jnl`	Phase diagram for two-layer ReLU neural networks at infinite-width limit. CoRR Tao Luo, Zhi-Qin John Xu, Zheng Ma, Yaoyu Zhang
2019	J	`jnl`	A type of generalization error induced by initialization in deep neural networks. CoRR Yaoyu Zhang, Zhi-Qin John Xu, Tao Luo, Zheng Ma
2019	J	`jnl`	Dynamical and Coupling Structure of Pulse-Coupled Networks in Maximum Entropy Analysis. Entropy Zhi-Qin John Xu, Douglas Zhou, David Cai
2019	J	`jnl`	Explicitizing an Implicit Bias of the Frequency Principle in Two-layer Neural Networks. CoRR Yaoyu Zhang, Zhi-Qin John Xu, Tao Luo, Zheng Ma
2019	J	`jnl`	Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks. CoRR Zhi-Qin John Xu, Yaoyu Zhang, Tao Luo, Yanyang Xiao, Zheng Ma
2019	J	`jnl`	Multi-scale Deep Neural Networks for Solving High Dimensional PDEs. CoRR Wei Cai, Zhi-Qin John Xu
2019	J	`jnl`	Theory of the Frequency Principle for General Deep Neural Networks. CoRR Tao Luo, Zheng Ma, Zhi-Qin John Xu, Yaoyu Zhang
2019	—	`conf`	Training Behavior of Deep Neural Network in Frequency Domain. ICONIP (1) Zhi-Qin John Xu, Yaoyu Zhang, Yanyang Xiao
2018	J	`jnl`	Frequency Principle in Deep Learning with General Loss Functions and Its Potential Application. CoRR Zhi-Qin John Xu
2018	J	`jnl`	Maximum Entropy Principle Analysis in Network Systems with Short-time Recordings. CoRR Zhi-Qin John Xu, Jennifer Crodelle, Douglas Zhou, David Cai
2018	J	`jnl`	Training behavior of deep neural network in frequency domain. CoRR Zhi-Qin John Xu, Yaoyu Zhang, Yanyang Xiao