Kenji Doya - RankMe

191 papers A* 7A 6B 12Journal 113Unranked 40

Year	Rank	Type	Title / Venue / Authors
2026	B	`conf`	CEBRA-Enabled Latent Embeddings of Wearable Biosignals for Personalized Biorhythm Modeling. PERSUASIVE Sutashu Tomonaga, Jo Fujimori, Yi-Shan Cheng, Haruo Mizutani, Kenji Doya
2026	—	`ed.`	Neural Information Processing - 32nd International Conference, ICONIP 2025, Okinawa, Japan, November 20-24, 2025, Proceedings, Part I ICONIP (1) Tadahiro Taniguchi, Andrew Chi-Sing Leung, Tadashi Kozuno, Junichiro Yoshimoto, Mufti Mahmud, Maryam Doborjeh, Kenji Doya
2026	—	`ed.`	Neural Information Processing - 32nd International Conference, ICONIP 2025, Okinawa, Japan, November 20-24, 2025, Proceedings, Part II ICONIP (2) Tadahiro Taniguchi, Andrew Chi-Sing Leung, Tadashi Kozuno, Junichiro Yoshimoto, Mufti Mahmud, Maryam Doborjeh, Kenji Doya
2026	—	`ed.`	Neural Information Processing - 32nd International Conference, ICONIP 2025, Okinawa, Japan, November 20-24, 2025, Proceedings, Part III ICONIP (3) Tadahiro Taniguchi, Andrew Chi-Sing Leung, Tadashi Kozuno, Junichiro Yoshimoto, Mufti Mahmud, Maryam Doborjeh, Kenji Doya
2026	—	`ed.`	Neural Information Processing - 32nd International Conference, ICONIP 2025, Okinawa, Japan, November 20-24, 2025, Proceedings, Part IV ICONIP (4) Tadahiro Taniguchi, Andrew Chi-Sing Leung, Tadashi Kozuno, Junichiro Yoshimoto, Mufti Mahmud, Maryam Doborjeh, Kenji Doya
2026	—	`ed.`	Neural Information Processing - 32nd International Conference, ICONIP 2025, Okinawa, Japan, November 20-24, 2025, Proceedings, Part V ICONIP (5) Tadahiro Taniguchi, Andrew Chi-Sing Leung, Tadashi Kozuno, Junichiro Yoshimoto, Mufti Mahmud, Maryam Doborjeh, Kenji Doya
2026	—	`conf`	Opportunistic Teacher Forcing: Training RNNs on Wearable Signals with Inherent Missing Data. BIOSTEC (1) Sutashu Tomonaga, Andres Hernandez-Matamoros, Haruo Mizutani, Kenji Doya
2026	—	`conf`	Transfer Learning from Clinical PSG to Real-World Wearables for Sleep Staging. BIOSTEC (4) Andres Hernandez-Matamoros, Kenji Doya, Sutashu Tomonaga, Haruo Mizutani
2025	J	`jnl`	Curiosity-Driven Development of Action and Language in Robots Through Self-Exploration. CoRR Theodore Jerome Tinker, Kenji Doya, Jun Tani
2025	J	`jnl`	Evolution of Fear and Social Rewards in Prey-Predator Relationship. CoRR Yuji Kanagawa, Kenji Doya
2025	J	`jnl`	Information-Theoretical Analysis of Team Dynamics in Football Matches. Entropy Yi-Shan Cheng, Acer Yu-Chan Chang, Kenji Doya
2025	J	`jnl`	Lag Operator SSMs: A Geometric Framework for Structured State Space Modeling. CoRR Sutashu Tomonaga, Kenji Doya, Noboru Murata
2025	J	`jnl`	Optical Neuroimage Studio (OptiNiSt): Intuitive, scalable, extendable framework for optical neuroimage data analysis. PLoS Comput. Biol. Yukako Yamane, Yuzhe Li, Keita Matsumoto, Ryota Kanai, Miles Desforges, Carlos Enrique Gutierrez, Kenji Doya
2025	A*	`conf`	Training Recurrent Neural Networks with Inherent Missing Data for Wearable Device Applications (Student Abstract). AAAI Sutashu Tomonaga, Haruo Mizutani, Kenji Doya
2024	J	`jnl`	A whole-brain analysis of functional connectivity and immediate early gene expression reveals functional network shifts after operant learning. NeuroImage Kazumi Kasahara, Keigo Hikishima, Mariko Nakata, Tomokazu Tsurugizawa, Noriyuki Higo, Kenji Doya
2024	J	`jnl`	Estimating Exoplanet Mass using Machine Learning on Incomplete Datasets. CoRR Florian Lalande, Elizabeth Tasker, Kenji Doya
2024	J	`jnl`	Evolution of Rewards for Food and Motor Action by Simulating Birth and Death. CoRR Yuji Kanagawa, Kenji Doya
2024	J	`jnl`	Intrinsic Rewards for Exploration Without Harm From Observational Noise: A Simulation Study Based on the Free Energy Principle. Neural Comput. Theodore Jerome Tinker, Kenji Doya, Jun Tani
2024	J	`jnl`	Intrinsic Rewards for Exploration without Harm from Observational Noise: A Simulation Study Based on the Free Energy Principle. CoRR Theodore Jerome Tinker, Kenji Doya, Jun Tani
2024	J	`jnl`	Respiratory modulation of the heart rate: A potential biomarker of cardiorespiratory function in human. Comput. Biol. Medicine Soheil Keshmiri, Sutashu Tomonaga, Haruo Mizutani, Kenji Doya
2023	J	`jnl`	Embodied bidirectional simulation of a spiking cortico-basal ganglia-cerebellar-thalamic brain model and a mouse musculoskeletal body model distributed across computers including the supercomputer Fugaku. Frontiers Neurorobotics Yusuke Kuniyoshi, Rin Kuriyama, Shu Omura, Carlos Enrique Gutierrez, Zhe Sun, Benedikt Feldotto, Ugo Albanese, Alois C. Knoll, Taiki Yamada, Tomoya Hirayama, Fabrice O. Morin, Jun Igarashi, Kenji Doya, Tadashi Yamazaki
2023	J	`jnl`	Enhancing reinforcement learning models by including direct and indirect pathways improves performance on striatal dependent tasks. PLoS Comput. Biol. Kim T. Blackwell, Kenji Doya
2023	J	`jnl`	Habits and goals in synergy: a variational Bayesian framework for behavior. CoRR Dongqi Han, Kenji Doya, Dongsheng Li, Jun Tani
2023	J	`jnl`	Numerical Data Imputation for Multimodal Data Sets: A Probabilistic Nearest-Neighbor Kernel Density Approach. CoRR Florian Lalande, Kenji Doya
2023	J	`jnl`	Numerical Data Imputation for Multimodal Data Sets: A Probabilistic Nearest-Neighbor Kernel Density Approach. Trans. Mach. Learn. Res. Florian Lalande, Kenji Doya
2022	J	`jnl`	A Spiking Neural Network Builder for Systematic Data-to-Model Workflow. Frontiers Neuroinformatics Carlos Enrique Gutierrez, Henrik Skibbe, Hugo Musset, Kenji Doya
2022	J	`jnl`	A whole brain probabilistic generative model: Toward realizing cognitive architectures for developmental robots. Neural Networks Tadahiro Taniguchi, Hiroshi Yamakawa, Takayuki Nagai, Kenji Doya, Masamichi Sakagami, Masahiro Suzuki, Tomoaki Nakamura, Akira Taniguchi
2022	J	`jnl`	Announcement of the Neural Networks Best Paper Award. Neural Networks Kenji Doya, DeLiang Wang
2022	J	`jnl`	Continual growth and a transition. Neural Networks Kenji Doya, Taro Toyoizumi, DeLiang Wang
2022	J	`jnl`	Deploying and Optimizing Embodied Simulations of Large-Scale Spiking Neural Networks on HPC Infrastructure. Frontiers Neuroinformatics Benedikt Feldotto, Jochen Martin Eppler, Cristian Jimenez-Romero, Christopher Bignamini, Carlos Enrique Gutierrez, Ugo Albanese, Eloy Retamino, Viktor Vorobev, Vahid Zolfaghari, Alex Upton, Zhe Sun, Hiroshi Yamaura, Morteza Heidarinejad, Wouter Klijn, Abigail Morrison, Felipe Cruz, Colin McMurtrie, Alois C. Knoll, Jun Igarashi, Tadashi Yamazaki, Kenji Doya, Fabrice O. Morin
2022	J	`jnl`	Neural Networks special issue on Artificial Intelligence and Brain Science. Neural Networks Kenji Doya, Karl J. Friston, Masashi Sugiyama, Joshua B. Tenenbaum
2022	B	`conf`	Numerical Data Imputation: Choose kNN over Deep Learning. SISAP Florian Lalande, Kenji Doya
2022	J	`jnl`	Social impact and governance of AI and neurotechnologies. Neural Networks Kenji Doya, Arisa Ema, Hiroaki Kitano, Masamichi Sakagami, Stuart Russell
2022	J	`jnl`	Special issue on Symbol Emergence in Robotics and Cognitive Systems (I). Adv. Robotics Tadahiro Taniguchi, Takayuki Nagai, Shingo Shimoda, Angelo Cangelosi, Yiannis Demiris, Yutaka Matsuo, Kenji Doya, Tetsuya Ogata, Lorenzo Jamone, Yukie Nagai, Emre Ugur, Daichi Mochihashi, Yuuya Unno, Kazuo Okanoya, Takashi Hashimoto
2022	J	`jnl`	Special issue on symbol emergence in robotics and cognitive systems (II). Adv. Robotics Tadahiro Taniguchi, Takayuki Nagai, Shingo Shimoda, Angelo Cangelosi, Yiannis Demiris, Yutaka Matsuo, Kenji Doya, Tetsuya Ogata, Lorenzo Jamone, Yukie Nagai, Emre Ugur, Daichi Mochihashi, Yuuya Unno, Kazuo Okanoya, Takashi Hashimoto
2022	A*	`conf`	Variational oracle guiding for reinforcement learning. ICLR Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li
2021	—	`conf`	Effects of transcranial direct current stimulation in brain-computer interface. LifeTech Kazumi Kasahara, Tatsuhiro Nakamura, Kazumasa Uehara, Yousuke Ogata, Kenji Doya, Takashi Hanakawa
2021	J	`jnl`	Forward and inverse reinforcement learning sharing network weights and hyperparameters. Neural Networks Eiji Uchibe, Kenji Doya
2021	J	`jnl`	Goal-Directed Planning by Reinforcement Learning and Active Inference. CoRR Dongqi Han, Kenji Doya, Jun Tani
2021	J	`jnl`	Maintaining the Publication Infrastructure in a Worldwide Pandemic. Neural Networks Kenji Doya, DeLiang Wang
2021	J	`jnl`	Whole brain Probabilistic Generative Model toward Realizing Cognitive Architecture for Developmental Robots. CoRR Tadahiro Taniguchi, Hiroshi Yamakawa, Takayuki Nagai, Kenji Doya, Masamichi Sakagami, Masahiro Suzuki, Tomoaki Nakamura, Akira Taniguchi
2020	J	`jnl`	Announcement of the Neural Networks Best Paper Award. Neural Networks Kenji Doya, DeLiang Wang
2020	J	`jnl`	Diffusion functional MRI reveals global brain network functional abnormalities driven by targeted local activity in a neuropsychiatric disease mouse model. NeuroImage Yoshifumi Abe, Norio Takata, Yuki Sakai, Hiro Taiyo Hamada, Yuichi Hiraoka, Tomomi Aida, Kohichi Tanaka, Denis Le Bihan, Kenji Doya, Kenji F. Tanaka
2020	J	`jnl`	Imitation learning based on entropy-regularized forward and inverse reinforcement learning. CoRR Eiji Uchibe, Kenji Doya
2020	—	`conf`	Maximum Credibility Voting (MCV) An Integrative Approach for Accurate Diagnosis of Major Depressive Disorder from Clinically Readily Available Data. APSIPA Yu Shimizu, Junichiro Yoshimoto, Masahiro Takamura, Go Okada, Tomoya Matsumoto, Manabu Fuchikami, Satoshi Okada, Shigeru Morinobu, Yasumasa Okamoto, Shigeto Yamawaki, Kenji Doya
2020	J	`jnl`	Self-organization of action hierarchy and compositionality by reinforcement learning with recurrent neural networks. Neural Networks Dongqi Han, Kenji Doya, Jun Tani
2020	A*	`conf`	Variational Recurrent Models for Solving Partially Observable Control Tasks. ICLR Dongqi Han, Kenji Doya, Jun Tani
2019	—	`conf`	An Experimental Study of Emergence of Communication of Reinforcement Learning Agents. AGI Qiong Huang, Kenji Doya
2019	J	`jnl`	Emergence of Hierarchy via Reinforcement Learning Using a Multiple Timescale Stochastic RNN. CoRR Dongqi Han, Kenji Doya, Jun Tani
2019	J	`jnl`	Gap-Increasing Policy Evaluation for Efficient and Noise-Tolerant Reinforcement Learning. CoRR Tadashi Kozuno, Dongqi Han, Kenji Doya
2019	J	`jnl`	Language as Goal-Directed Sequential Behavior: Computational Theories, Brain Mechanisms, Evolutionary Roots (NII Shonan Meeting 141). NII Shonan Meet. Rep. Kenji Doya, Shimon Edelman, Takashi Hashimoto
2019	J	`jnl`	MarmoNet: a pipeline for automated projection mapping of the common marmoset brain from whole-brain serial two-photon tomography. CoRR Henrik Skibbe, Akiya Watakabe, Ken Nakae, Carlos Enrique Gutierrez, Hiromichi Tsukada, Junichi Hata, Takashi Kawase, Rui Gong, Alexander Woodward, Kenji Doya, Hideyuki Okano, Tetsuo Yamamori, Shin Ishii
2019	—	`conf`	Model-based Empowerment Computation for Dynamical Agents. SSCI Yuma Kajihara, Takashi Ikegami, Kenji Doya
2019	J	`jnl`	PIPPS: Flexible Model-Based Policy Search Robust to the Curse of Chaos. CoRR Paavo Parmas, Carl Edward Rasmussen, Jan Peters, Kenji Doya
2019	A	`conf`	Theoretical Analysis of Efficiency and Robustness of Softmax and Gap-Increasing Operators in Reinforcement Learning. AISTATS Tadashi Kozuno, Eiji Uchibe, Kenji Doya
2019	J	`jnl`	Variational Recurrent Models for Solving Partially Observable Control Tasks. CoRR Dongqi Han, Kenji Doya, Jun Tani
2018	J	`jnl`	Connectivity inference from neural recording data: Challenges, mathematical bases and research directions. Neural Networks Ildefons Magrans de Abril, Junichiro Yoshimoto, Kenji Doya
2018	J	`jnl`	Fostering deep learning and beyond. Neural Networks Kenji Doya, DeLiang Wang
2018	A	`conf`	Online meta-learning by parallel algorithm competition. GECCO Stefan Elfwing, Eiji Uchibe, Kenji Doya
2018	A*	`conf`	PIPPS: Flexible Model-Based Policy Search Robust to the Curse of Chaos. ICML Paavo Parmas, Carl Edward Rasmussen, Jan Peters, Kenji Doya
2018	J	`jnl`	Robustness of linearly solvable Markov games employing inaccurate dynamics model. Artif. Life Robotics Ken Kinjo, Eiji Uchibe, Kenji Doya
2018	J	`jnl`	Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural Networks Stefan Elfwing, Eiji Uchibe, Kenji Doya
2018	J	`jnl`	Unbounded Output Networks for Classification. CoRR Stefan Elfwing, Eiji Uchibe, Kenji Doya
2017	J	`jnl`	Adaptive Baseline Enhances EM-Based Policy Search: Validation in a View-Based Positioning Task of a Smartphone Balancer. Frontiers Neurorobotics Jiexin Wang, Eiji Uchibe, Kenji Doya
2017	J	`jnl`	Announcement of the Neural Networks Best Paper Award. Neural Networks Kenji Doya, DeLiang Wang
2017	—	`conf`	Average Reward Optimization with Multiple Discounting Reinforcement Learners. ICONIP (1) Chris Reinke, Eiji Uchibe, Kenji Doya
2017	J	`jnl`	Online Meta-learning by Parallel Algorithm Competition. CoRR Stefan Elfwing, Eiji Uchibe, Kenji Doya
2017	J	`jnl`	Promoting Further Developments of Neural Networks. Neural Networks Kenji Doya, DeLiang Wang
2017	J	`jnl`	Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning. CoRR Stefan Elfwing, Eiji Uchibe, Kenji Doya
2017	J	`jnl`	Sparse kernel canonical correlation analysis for discovery of nonlinear interactions in high-dimensional data. BMC Bioinform. Kosuke Yoshida, Junichiro Yoshimoto, Kenji Doya
2017	J	`jnl`	Unifying Value Iteration, Advantage Learning, and Dynamic Policy Programming. CoRR Tadashi Kozuno, Eiji Uchibe, Kenji Doya
2016	J	`jnl`	EM-based policy hyper parameter exploration: application to standing and balancing of a two-wheeled smartphone robot. Artif. Life Robotics Jiexin Wang, Eiji Uchibe, Kenji Doya
2016	—	`conf`	Emergence of communication among reinforcement learning agents under coordination environment. ICDL-EPIROB Qiong Huang, Eiji Uchibe, Kenji Doya
2016	J	`jnl`	From free energy to expected energy: Improving energy-based value function approximation in reinforcement learning. Neural Networks Stefan Elfwing, Eiji Uchibe, Kenji Doya
2016	—	`ed.`	Neural Information Processing - 23rd International Conference, ICONIP 2016, Kyoto, Japan, October 16-21, 2016, Proceedings, Part I ICONIP (1) Akira Hirose, Seiichi Ozawa, Kenji Doya, Kazushi Ikeda, Minho Lee, Derong Liu
2016	—	`ed.`	Neural Information Processing - 23rd International Conference, ICONIP 2016, Kyoto, Japan, October 16-21, 2016, Proceedings, Part II ICONIP (2) Akira Hirose, Seiichi Ozawa, Kenji Doya, Kazushi Ikeda, Minho Lee, Derong Liu
2016	—	`ed.`	Neural Information Processing - 23rd International Conference, ICONIP 2016, Kyoto, Japan, October 16-21, 2016, Proceedings, Part III ICONIP (3) Akira Hirose, Seiichi Ozawa, Kenji Doya, Kazushi Ikeda, Minho Lee, Derong Liu
2016	—	`ed.`	Neural Information Processing - 23rd International Conference, ICONIP 2016, Kyoto, Japan, October 16-21, 2016, Proceedings, Part IV ICONIP (4) Akira Hirose, Seiichi Ozawa, Kenji Doya, Kazushi Ikeda, Minho Lee, Derong Liu
2016	J	`jnl`	State of Neural Networks Is Strong. Neural Networks Kenji Doya, DeLiang Wang
2015	—	`conf`	Computational Complexity Reduction for Functional Connectivity Estimation in Large Scale Neural Network. ICONIP (3) Jeonghun Baek, Shigeyuki Oba, Junichiro Yoshimoto, Kenji Doya, Shin Ishii
2015	J	`jnl`	Expected energy-based restricted Boltzmann machine for classification. Neural Networks Stefan Elfwing, Eiji Uchibe, Kenji Doya
2015	J	`jnl`	Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum. PLoS Comput. Biol. Makoto Ito, Kenji Doya
2015	—	`conf`	Resting state functional connectivity explains individual scores of multiple clinical measures for major depression. BIBM Kosuke Yoshida, Yu Shimizu, Junichiro Yoshimoto, Shigeru Toki, Go Okada, Masahiro Takamura, Yasumasa Okamoto, Shigeto Yamawaki, Kenji Doya
2014	A*	`conf`	Combining learned controllers to achieve new goals based on linearly solvable MDPs. ICRA Eiji Uchibe, Kenji Doya
2014	—	`conf`	Inter Subject Correlation of Brain Activity during Visuo-Motor Sequence Learning. ICONIP (1) Krishna P. Miyapuram, Ujjval Pamnani, Kenji Doya, Raju S. Bapi
2014	—	`conf`	Inverse reinforcement learning using Dynamic Policy Programming. ICDL-EPIROB Eiji Uchibe, Kenji Doya
2013	J	`jnl`	A model-based prediction of the calcium responses in the striatal synaptic spines depending on the timing of cortical and dopaminergic inputs and post-synaptic spikes. Frontiers Comput. Neurosci. Takashi Nakano, Junichiro Yoshimoto, Kenji Doya
2013	J	`jnl`	Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task. Frontiers Neurorobotics Ken Kinjo, Eiji Uchibe, Kenji Doya
2013	—	`conf`	Reinforcement learning with state-dependent discount factor. ICDL-EPIROB Naoto Yoshida, Eiji Uchibe, Kenji Doya
2013	J	`jnl`	Scaled free-energy based reinforcement learning for robust and efficient learning in high-dimensional state spaces. Frontiers Neurorobotics Stefan Elfwing, Eiji Uchibe, Kenji Doya
2012	J	`jnl`	Changing the structure of complex visuo-motor sequences selectively activates the fronto-parietal network. NeuroImage Chandrasekhar V. S. Pammi, Krishna P. Miyapuram, Ahmed, Kazuyuki Samejima, Raju S. Bapi, Kenji Doya
2012	J	`jnl`	Expedited review process. Neural Networks Kenji Doya, John G. Taylor, DeLiang Wang
2012	J	`jnl`	Loss of a Co-Editor-in-Chief and friend. Neural Networks Kenji Doya, DeLiang Wang
2012	J	`jnl`	MOSAIC for Multiple-Reward Environments. Neural Comput. Norikazu Sugimoto, Masahiko Haruno, Kenji Doya, Mitsuo Kawato
2012	B	`conf`	Neural Computations Supporting Cognition: Rumelhart Prize Symposium in Honor of Peter Dayan. CogSci Kenji Doya, John P. O'Doherty, Alexandre Pouget, Peter Bossaerts, Nathaniel D. Daw, Yael Niv
2011	J	`jnl`	An excellent year and a transition. Neural Networks Kenji Doya, Stephen Grossberg, John G. Taylor, DeLiang Wang
2011	J	`jnl`	Darwinian embodied evolution of the learning ability for survival. Adapt. Behav. Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen
2011	J	`jnl`	Multi-scale, multi-modal neural modeling and simulation. Neural Networks Shin Ishii, Markus Diesmann, Kenji Doya
2011	J	`jnl`	Neurocomputational models of brain disorders. Neural Networks Vassilis Cutsuridis, Tjitske Heida, Wlodek Duch, Kenji Doya
2010	J	`jnl`	A Kinetic Model of Dopamine- and Calcium-Dependent Striatal Synaptic Plasticity. PLoS Comput. Biol. Takashi Nakano, Tomokazu Doi, Junichiro Yoshimoto, Kenji Doya
2010	J	`jnl`	A computational neural model of goal-directed utterance selection. Neural Networks Michael Klein, Hans Kamp, Guenther Palm, Kenji Doya
2010	J	`jnl`	Adaptive Selection of Learning Strategy for Autonomous Sequence Learning in Rats. Aust. J. Intell. Inf. Process. Syst. Masato Hoshino, Hiroshi Tsujino, Kenji Doya
2010	J	`jnl`	Derivatives of Logarithmic Stationary Distributions for Policy Gradient Reinforcement Learning. Neural Comput. Tetsuro Morimura, Eiji Uchibe, Junichiro Yoshimoto, Jan Peters, Kenji Doya
2010	J	`jnl`	Editorial for 2010. Neural Networks Kenji Doya, Stephen Grossberg, John G. Taylor
2010	—	`conf`	Free-Energy Based Reinforcement Learning for Vision-Based Navigation with High-Dimensional Sensory Inputs. ICONIP (1) Stefan Elfwing, Makoto Otsuka, Eiji Uchibe, Kenji Doya
2010	B	`conf`	Free-energy-based reinforcement learning in a partially observable environment. ESANN Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
2010	—	`conf`	Toward a Spiking-Neuron Model of the Oculomotor System. SAB Jan Morén, Tomohiro Shibata, Kenji Doya
2009	—	`conf`	A Generalized Natural Actor-Critic Algorithm. NIPS Tetsuro Morimura, Eiji Uchibe, Junichiro Yoshimoto, Kenji Doya
2009	J	`jnl`	A hierarchical Bayesian method to resolve an inverse problem of MEG contaminated with eye movement artifacts. NeuroImage Yusuke Fujiwara, Okito Yamashita, Dai Kawawaki, Kenji Doya, Mitsuo Kawato, Keisuke Toyama, Masa-aki Sato
2009	—	`conf`	Calcium Responses Model in Striatum Dependent on Timed Input Sources. ICANN (1) Takashi Nakano, Junichiro Yoshimoto, Jeff Wickens, Kenji Doya
2009	—	`ch.`	Co-evolution of Rewards and Meta-parameters in Embodied Evolution. Creating Brain-Like Intelligence Stefan Elfwing, Eiji Uchibe, Kenji Doya
2009	—	`book`	Creating Brain-Like Intelligence: From Basic Principles to Complex Intelligent Systems Creating Brain-Like Intelligence Bernhard Sendhoff, Edgar Körner, Olaf Sporns, Helge J. Ritter, Kenji Doya
2009	—	`conf`	Emergence of Different Mating Strategies in Artificial Embodied Evolution. ICONIP (2) Stefan Elfwing, Eiji Uchibe, Kenji Doya
2009	J	`jnl`	New action editors join the journal! Five exciting special issues in the works! Neural Networks Kenji Doya, Stephen Grossberg, John G. Taylor
2008	—	`conf`	A New Natural Policy Gradient by Stationary Distribution Metric. ECML/PKDD (2) Tetsuro Morimura, Eiji Uchibe, Junichiro Yoshimoto, Kenji Doya
2008	J	`jnl`	Co-evolution of Shaping Rewards and Meta-Parameters in Reinforcement Learning. Adapt. Behav. Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen
2008	J	`jnl`	Combining Modalities with Different Latencies for Optimal Motor Control. J. Cogn. Neurosci. Fredrik Bissmarck, Hiroyuki Nakahara, Kenji Doya, Okihide Hikosaka
2008	J	`jnl`	Finding intrinsic rewards by embodied evolution and constrained reinforcement learning. Neural Networks Eiji Uchibe, Kenji Doya
2008	J	`jnl`	Learning how, what, and whether to communicate: emergence of protocommunication in reinforcement learning agents. Artif. Life Robotics Takashi Sato, Eiji Uchibe, Kenji Doya
2008	J	`jnl`	Mini-special issue: ICONIP 2007. Neural Networks Masumi Ishikawa, Kenji Doya
2008	J	`jnl`	Natural actor-critic with baseline adjustment for variance reduction. Artif. Life Robotics Tetsuro Morimura, Eiji Uchibe, Kenji Doya
2008	—	`ed.`	Neural Information Processing, 14th International Conference, ICONIP 2007, Kitakyushu, Japan, November 13-16, 2007, Revised Selected Papers, Part I ICONIP (1) Masumi Ishikawa, Kenji Doya, Hiroyuki Miyamoto, Takeshi Yamakawa
2008	—	`ed.`	Neural Information Processing, 14th International Conference, ICONIP 2007, Kitakyushu, Japan, November 13-16, 2007, Revised Selected Papers, Part II ICONIP (2) Masumi Ishikawa, Kenji Doya, Hiroyuki Miyamoto, Takeshi Yamakawa
2008	J	`jnl`	Neural Networks goes electronic at twenty! Neural Networks Kenji Doya, Stephen Grossberg, John G. Taylor
2008	—	`conf`	NeuroEvolution Based on Reusable and Hierarchical Modular Representation. ICONIP (1) Takumi Kamioka, Eiji Uchibe, Kenji Doya
2008	—	`conf`	Robust Population Coding in Free-Energy-Based Reinforcement Learning. ICANN (1) Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya
2007	—	`conf`	Bayesian System Identification of Molecular Cascades. ICONIP (1) Junichiro Yoshimoto, Kenji Doya
2007	—	`conf`	Designing the Reward System: Computational and Biological Principles. FOCI Kenji Doya
2007	J	`jnl`	Erratum to "Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics" [Neural Networks 19 (8) (2006) 1233-1241]. Neural Networks Saori C. Tanaka, Kazuyuki Samejima, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki, Kenji Doya
2007	—	`conf`	Estimating Internal Variables of a Decision Maker's Brain: A Model-Based Approach for Neuroscience. ICONIP (1) Kazuyuki Samejima, Kenji Doya
2007	J	`jnl`	Evolutionary Development of Hierarchical Learning Structures. IEEE Trans. Evol. Comput. Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen
2007	—	`conf`	Finding Exploratory Rewards by Embodied Evolution and Constrained Reinforcement Learning in the Cyber Rodents. ICONIP (2) Eiji Uchibe, Kenji Doya
2007	J	`jnl`	Learning a dynamic policy by using policy gradient: application to biped walking. Syst. Comput. Jpn. Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya
2007	J	`jnl`	Multiple model-based reinforcement learning explains dopamine neuronal activity. Neural Networks Mathieu Bertin, Nicolas Schweighofer, Kenji Doya
2007	J	`jnl`	Nitric Oxide Regulates Input Specificity of Long-Term Depression and Context Dependence of Cerebellar Learning. PLoS Comput. Biol. Hideaki Ogasawara, Tomokazu Doi, Kenji Doya, Mitsuo Kawato
2007	J	`jnl`	Reinforcement Learning State Estimator. Neural Comput. Jun Morimoto, Kenji Doya
2006	J	`jnl`	Application of evolutionary computation for efficient reinforcement learning. Appl. Artif. Intell. Genci Capi, Kenji Doya
2006	J	`jnl`	Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics. Neural Networks Saori C. Tanaka, Kazuyuki Samejima, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki, Kenji Doya
2006	B	`conf`	Hierarchical Chunking during Learning of Visuomotor Sequences. IJCNN Krishna P. Miyapuram, Raju S. Bapi, Chandrasekhar V. S. Pammi, Ahmed, Kenji Doya
2006	J	`jnl`	Humans Can Adopt Optimal Discounting Strategy under Real-Time Constraints. PLoS Comput. Biol. Nicolas Schweighofer, K. Shishida, Cheol E. Han, Yasumasa Okamoto, Saori C. Tanaka, Shigeto Yamawaki, Kenji Doya
2006	J	`jnl`	Learning CPG-based biped locomotion with a policy gradient method. Robotics Auton. Syst. Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya
2006	J	`jnl`	Switching particle filters for efficient visual tracking. Robotics Auton. Syst. Takashi Bando, Tomohiro Shibata, Kenji Doya, Shin Ishii
2006	J	`jnl`	fMRI investigation of cortical and subcortical networks in the learning of abstract and effector-specific representations of motor sequences. NeuroImage Raju S. Bapi, Krishna P. Miyapuram, F. X. Graydon, Kenji Doya
2005	B	`conf`	Biologically inspired embodied evolution of survival. Congress on Evolutionary Computation Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen
2005	J	`jnl`	Evolution of Neural Architecture Fitting Environmental Dynamics. Adapt. Behav. Genci Capi, Kenji Doya
2005	J	`jnl`	Evolution of recurrent neural controllers using an extended parallel genetic algorithm. Robotics Auton. Syst. Genci Capi, Kenji Doya
2005	—	`conf`	Learning CPG-based biped locomotion with a policy gradient method. Humanoids Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya
2005	A*	`conf`	Learning Sensory Feedback to CPG with Policy Gradient for Biped Locomotion. ICRA Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya
2005	J	`jnl`	Robust Reinforcement Learning. Neural Comput. Jun Morimoto, Kenji Doya
2005	J	`jnl`	The Cyber Rodent Project: Exploration of Adaptive Mechanisms for Self-Preservation and Self-Reproduction. Adapt. Behav. Kenji Doya, Eiji Uchibe
2004	B	`conf`	Chunking Phenomenon in Complex Sequential Skill Learning in Humans. ICONIP Chandrasekhar V. S. Pammi, Krishna P. Miyapuram, Raju S. Bapi, Kenji Doya
2004	J	`jnl`	Hierarchical Bayesian estimation for MEG inverse problem. NeuroImage Masa-aki Sato, Taku Yoshioka, Shigeki Kajihara, Keisuke Toyama, Naokazu Goda, Kenji Doya, Mitsuo Kawato
2004	A	`conf`	Multi-agent reinforcement learning: using macro actions to learn a mating task. IROS Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen
2004	J	`jnl`	Reinforcement learning with via-point representation. Neural Networks Hiroyuki Miyamoto, Jun Morimoto, Kenji Doya, Mitsuo Kawato
2004	—	`conf`	Responding to Modalities with Different Latencies. NIPS Fredrik Bissmarck, Hiroyuki Nakahara, Kenji Doya, Okihide Hikosaka
2004	—	`conf`	Switching Particle Filters for Efficient Real-time Visual Tracking. ICPR (2) Takashi Bando, Tomohiro Shibata, Kenji Doya, Shin Ishii
2003	A	`conf`	An Evolutionary Approach to Automatic Construction of the Structure in Hierarchical Reinforcement Learning. GECCO Stefan Elfwing, Eiji Uchibe, Kenji Doya
2003	—	`conf`	Different Cortico-Basal Ganglia Loops Specialize in Reward Prediction at Different Time Scales. NIPS Saori C. Tanaka, Kenji Doya, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki
2003	—	`conf`	Estimating Internal Variables and Paramters of a Learning Agent by a Particle Filter. NIPS Kazuyuki Samejima, Kenji Doya, Yasumasa Ueda, Minoru Kimura
2003	A	`conf`	Evolution of meta-parameters in reinforcement learning algorithm. IROS Anders Eriksson, Genci Capi, Kenji Doya
2003	B	`conf`	Evolving recurrent neural controllers for sequential tasks: a parallel implementation. IEEE Congress on Evolutionary Computation Genci Capi, Kenji Doya
2003	J	`jnl`	Inter-module credit assignment in modular reinforcement learning. Neural Networks Kazuyuki Samejima, Kenji Doya, Mitsuo Kawato
2003	J	`jnl`	Meta-learning in Reinforcement Learning. Neural Networks Nicolas Schweighofer, Kenji Doya
2002	J	`jnl`	Introduction for 2002 Special Issue: Computational Models of Neuromodulation. Neural Networks Kenji Doya, Peter Dayan, Michael E. Hasselmo
2002	J	`jnl`	Metalearning and neuromodulation. Neural Networks Kenji Doya
2002	J	`jnl`	Multiple Model-Based Reinforcement Learning. Neural Comput. Kenji Doya, Kazuyuki Samejima, Ken-ichi Katagiri, Mitsuo Kawato
2001	J	`jnl`	Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. Robotics Auton. Syst. Jun Morimoto, Kenji Doya
2001	—	`conf`	Multiple Forward Model Architecture for Sequence Processing. Sequence Learning Raju S. Bapi, Kenji Doya
2001	J	`jnl`	Statistical characteristics of climbing fiber spikes necessary for efficient cerebellar learning. Biol. Cybern. Shinya Kuroda, Kenji Yamamoto, Hiroyuki Miyamoto, Kenji Doya, Mitsuo Kawato
2000	A*	`conf`	Acquisition of Stand-up Behavior by a Real Robot using Hierarchical Reinforcement Learning. ICML Jun Morimoto, Kenji Doya
2000	—	`conf`	Multi-Agent Reinforcement Learning: An Approach Based on the Other Agent's Internal Model. ICMAS Yasuo Nagayuki, Shin Ishii, Kenji Doya
2000	J	`jnl`	Reinforcement Learning in Continuous Time and Space. Neural Comput. Kenji Doya
2000	—	`conf`	Robust Reinforcement Learning. NIPS Jun Morimoto, Kenji Doya
1999	J	`jnl`	What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Networks Kenji Doya
1998	B	`conf`	A Model of the Electrophysiological Properties of the Inferior Olive Neurons. ICONIP Nicolas Schweighofer, Kenji Doya, Mitsuo Kawato
1998	B	`conf`	A Sequence Learning Architecture Based on Cortico-Basal Ganglionic Loops and Reinforcement Learning. ICONIP Raju S. Bapi, Kenji Doya
1998	B	`conf`	Hierarchical Reinforcement Learning of Low-Dimensional Subgoals and High-Dimensional Trajectories. ICONIP Jun Morimoto, Kenji Doya
1998	J	`jnl`	Hierarchical reinforcement learning for motion learning: learning 'stand-up' trajectories. Adv. Robotics Jun Morimoto, Kenji Doya
1998	J	`jnl`	Near Saddle-Node Bifurcation Behavior as Dynamics in Working Memory for Goal-Directed Behavior. Neural Comput. Hiroyuki Nakahara, Kenji Doya
1998	A	`conf`	Reinforcement learning of dynamic motor sequence: learning to stand up. IROS Jun Morimoto, Kenji Doya
1996	—	`conf`	Efficient Nonlinear Control with Actor-Tutor Architecture. NIPS Kenji Doya
1995	—	`conf`	Dynamics of Attention as Near Saddle-Node Bifurcation Behavior. NIPS Hiroyuki Nakahara, Kenji Doya
1995	—	`conf`	Temporal Difference Learning in Continuous Time and Space. NIPS Kenji Doya
1994	—	`conf`	A Novel Reinforcement Model of Birdsong Vocalization Learning. NIPS Kenji Doya, Terrence J. Sejnowski
1994	J	`jnl`	Dimension Reduction of Biological Neuron Models by Artificial Neural Networks. Neural Comput. Kenji Doya, Allen I. Selverston
1993	—	`conf`	A Hodgkin-Huxley Type Neuron Model That Learns Slow Non-Spike Oscillations. NIPS Kenji Doya, Allen I. Selverston, Peter F. Rowat
1992	—	`conf`	Maaping Between Neural and Physical Activities of the Lobster Gastric Mill. NIPS Kenji Doya, Mary E. T. Boyle, Allen I. Selverston
1991	—	`conf`	Adaptive Synchronization of Neural and Physical Oscillators. NIPS Kenji Doya, Shuji Yoshizawa
1991	J	`jnl`	Neural network model of temporal pattern memory. Syst. Comput. Jpn. Kenji Doya, Shuji Yoshizawa
1990	B	`conf`	Memorizing hierarchical temporal patterns in analog neuron networks. IJCNN Kenji Doya, Shuji Yoshizawa
1989	J	`jnl`	Adaptive neural oscillator using continuous-time back-propagation learning. Neural Networks Kenji Doya, Shuji Yoshizawa