Shalabh Bhatnagar

278 papers A* 11A 10B 18C 4Misc 11Journal 186Unranked 37

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	An Actor-Critic Algorithm With Function Approximation for Risk Sensitive Cost Markov Decision Processes. IEEE Trans. Autom. Control. Soumyajit Guin, Vivek S. Borkar, Shalabh Bhatnagar
2026	J	`jnl`	Finite-time analysis of Multi-timescale Stochastic Optimization Algorithms. CoRR Kaustubh Kartikey, Shalabh Bhatnagar
2026	J	`jnl`	Generalized Random Direction Newton Algorithms for Stochastic Optimization. CoRR Soumen Pachal, Prashanth L. A., Shalabh Bhatnagar, Avinash Achar
2026	J	`jnl`	High-Probability Bounds for SGD under the Polyak-Lojasiewicz Condition with Markovian Noise. CoRR Avik Kar, Siddharth Chandak, Rahul Singh, Eric Moulines, Shalabh Bhatnagar, Nicholas Bambos
2026	J	`jnl`	Optimizing Successive Over-Relaxation Q-Learning With Deterministic Perturbation Gradient Search. IEEE Trans. Artif. Intell. Lakshmi Mandal, Shalabh Bhatnagar
2025	J	`jnl`	Accelerating SfM-based Pose Estimation with Dominating Set. CoRR Joji Joseph, Bharadwaj Amrutur, Shalabh Bhatnagar
2025	J	`jnl`	An Actor-Critic Algorithm with Function Approximation for Risk Sensitive Cost Markov Decision Processes. CoRR Soumyajit Guin, Vivek S. Borkar, Shalabh Bhatnagar
2025	J	`jnl`	Approximate linear programming for decentralized policy iteration in cooperative multi-agent Markov decision processes. Syst. Control. Lett. Lakshmi Mandal, Chandrashekar Lakshminarayanan, Shalabh Bhatnagar
2025	J	`jnl`	Convergence of Multiagent Learning Systems for Traffic control. CoRR Sayambhu Sen, Shalabh Bhatnagar
2025	J	`jnl`	Convergent Reinforcement Learning Algorithms for Stochastic Shortest Path Problem. CoRR Soumyajit Guin, Shalabh Bhatnagar
2025	J	`jnl`	Deep SOR Minimax Q-learning for Two-player Zero-sum Game. CoRR Saksham Gautam, Lakshmi Mandal, Shalabh Bhatnagar
2025	J	`jnl`	Enabling Off-Policy Imitation Learning with Deep Actor Critic Stabilization. CoRR Sayambhu Sen, Shalabh Bhatnagar
2025	J	`jnl`	Finite Time Analysis of Constrained Natural Critic-Actor Algorithm with Improved Sample Complexity. CoRR Prashansa Panda, Shalabh Bhatnagar
2025	J	`jnl`	Generalized Simultaneous Perturbation-Based Gradient Search With Reduced Estimator Bias. IEEE Trans. Autom. Control. Soumen Pachal, Shalabh Bhatnagar, Prashanth L. A.
2025	J	`jnl`	Gradient-Based Algorithms for Zeroth-Order Optimization. Found. Trends Optim. Prashanth L. A., Shalabh Bhatnagar
2025	A*	`conf`	Gradient-Weighted Feature Back-Projection: A Fast Alternative to Feature Distillation in 3D Gaussian Splatting. SIGGRAPH Asia Joji Joseph, Bharadwaj Amrutur, Shalabh Bhatnagar
2025	A*	`conf`	Two-Timescale Critic-Actor for Average Reward MDPs with Function Approximation. AAAI Prashansa Panda, Shalabh Bhatnagar
2025	J	`jnl`	Variance Reduced Smoothed Functional REINFORCE Policy Gradient Algorithms. Trans. Mach. Learn. Res. Shalabh Bhatnagar, Deepak H. R
2025	J	`jnl`	n-step temporal difference learning with optimal n. Autom. Lakshmi Mandal, Shalabh Bhatnagar
2024	A	`conf`	A Cubic-regularized Policy Newton Algorithm for Reinforcement Learning. AISTATS Mizhaan Prajit Maniyar, Prashanth L. A., Akash Mondal, Shalabh Bhatnagar
2024	J	`jnl`	Critic-Actor for Average Reward MDPs with Function Approximation: A Finite-Time Analysis. CoRR Prashansa Panda, Shalabh Bhatnagar
2024	—	`conf`	Dynamic Energy Management in Competing Microgrids using Reinforcement Learning. ISGT V. P. Vivek, Raghuram Bharadwaj Diddigi, Shalabh Bhatnagar
2024	J	`jnl`	Energy Management in a Cooperative Energy Harvesting Wireless Sensor Network. IEEE Commun. Lett. Arghyadeep Barat, Prabuchandran K. J., Shalabh Bhatnagar
2024	A	`conf`	Finite-Time Analysis of Three-Timescale Constrained Actor-Critic and Constrained Natural Actor-Critic Algorithms. UAI Prashansa Panda, Shalabh Bhatnagar
2024	J	`jnl`	Gradient-Driven 3D Segmentation and Affordance Transfer in Gaussian Splatting Using 2D Masks. CoRR Joji Joseph, Bharadwaj Amrutur, Shalabh Bhatnagar
2024	J	`jnl`	Gradient-Weighted Feature Back-Projection: A Fast Alternative to Feature Distillation in 3D Gaussian Splatting. CoRR Joji Joseph, Bharadwaj Amrutur, Shalabh Bhatnagar
2024	—	`conf`	Learning Dynamic Representations in Large Language Models for Evolving Data Streams. ICPR (5) Ashish Srivastava, Shalabh Bhatnagar, M. Narasimha Murty, Jagannathan Ramanujam
2024	—	`conf`	Reinforcement Learning Algorithms with Graph Convolution Networks for Traffic Signal Control. INTSYS Shreya Salmalge, Shalabh Bhatnagar
2024	—	`conf`	Segmentation of 3D Gaussians using Masked Gradients. SIGGRAPH Asia Posters Joji Joseph, Bharadwaj Amrutur, Shalabh Bhatnagar
2024	J	`jnl`	Truncated Cauchy random perturbations for smoothed functional-based stochastic optimization. Autom. Akash Mondal, Prashanth L. A., Shalabh Bhatnagar
2024	J	`jnl`	Variance-Reduced Deep Actor-Critic With an Optimally Subsampled Actor Recursion. IEEE Trans. Artif. Intell. Lakshmi Mandal, Raghuram Bharadwaj Diddigi, Shalabh Bhatnagar
2023	J	`jnl`	A Cubic-regularized Policy Newton Algorithm for Reinforcement Learning. CoRR Mizhaan Prajit Maniyar, Akash Mondal, Prashanth L. A., Shalabh Bhatnagar
2023	J	`jnl`	A Framework for Provably Stable and Consistent Training of Deep Feedforward Networks. CoRR Arunselvan Ramaswamy, Shalabh Bhatnagar, Naman Saxena
2023	—	`conf`	A Policy Gradient Approach for Finite Horizon Constrained Markov Decision Processes. CDC Soumyajit Guin, Shalabh Bhatnagar
2023	J	`jnl`	Actor-Critic or Critic-Actor? A Tale of Two Time Scales. IEEE Control. Syst. Lett. Shalabh Bhatnagar, Vivek S. Borkar, Soumyajit Guin
2023	J	`jnl`	Approximate Linear Programming and Decentralized Policy Improvement in Cooperative Multi-agent Markov Decision Processes. CoRR Lakshmi Mandal, Chandrashekar Lakshminarayanan, Shalabh Bhatnagar
2023	B	`conf`	Autonomous UAV Navigation in Complex Environments using Human Feedback. RO-MAN Sambhu H. Karumanchi, Raghuram Bharadwaj Diddigi, Prabuchandran K. J., Shalabh Bhatnagar
2023	J	`jnl`	Energy Management in a Cooperative Energy Harvesting Wireless Sensor Network. CoRR Arghyadeep Barat, Prabuchandran K. J., Shalabh Bhatnagar
2023	J	`jnl`	Finite Time Analysis of Constrained Actor Critic and Constrained Natural Actor Critic Algorithms. CoRR Prashansa Panda, Shalabh Bhatnagar
2023	Misc	`conf`	Generalized Simultaneous Perturbation Stochastic Approximation with Reduced Estimator Bias. CISS Shalabh Bhatnagar, Prashanth L. A.
2023	A*	`conf`	Off-Policy Average Reward Actor-Critic with Deterministic Policy Search. ICML Naman Saxena, Subhojyoti Khastagir, Shishir Kolathaya, Shalabh Bhatnagar
2023	J	`jnl`	Off-Policy Average Reward Actor-Critic with Deterministic Policy Search. CoRR Naman Saxena, Subhojyoti Khastagir, Shishir Kolathaya, Shalabh Bhatnagar
2023	J	`jnl`	The Reinforce Policy Gradient Algorithm Revisited. CoRR Shalabh Bhatnagar
2023	J	`jnl`	n-Step Temporal Difference Learning with Optimal n. CoRR Lakshmi Mandal, Shalabh Bhatnagar
2022	J	`jnl`	A Generalized Minimax Q-Learning Algorithm for Two-Player Zero-Sum Stochastic Games. IEEE Trans. Autom. Control. Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, Shalabh Bhatnagar
2022	J	`jnl`	A Gradient Smoothed Functional Algorithm with Truncated Cauchy Random Perturbations for Stochastic Optimization. CoRR Akash Mondal, Prashanth L. A., Shalabh Bhatnagar
2022	J	`jnl`	A policy gradient approach for Finite Horizon Constrained Markov Decision Processes. CoRR Soumyajit Guin, Shalabh Bhatnagar
2022	J	`jnl`	Actor-Critic or Critic-Actor? A Tale of Two Time Scales. CoRR Shalabh Bhatnagar, Vivek S. Borkar, Soumyajit Guin
2022	J	`jnl`	Analyzing Approximate Value Iteration Algorithms. Math. Oper. Res. Arunselvan Ramaswamy, Shalabh Bhatnagar
2022	—	`conf`	Co-operative Multi-agent Twin Delayed DDPG for Robust Phase Duration Optimization of Large Road Networks. ICAART (Revised Selected Paper Priya Shanmugasundaram, Shalabh Bhatnagar
2022	B	`conf`	Data Efficient Safe Reinforcement Learning. SMC Sindhu Padakandla, Prabuchandran K. J., Sourav Ganguly, Shalabh Bhatnagar
2022	A*	`conf`	Dynamic Mirror Descent based Model Predictive Control for Accelerating Robot Learning. ICRA Utkarsh A. Mishra, Soumya R. Samineni, Prakhar Goel, Chandravaran Kunjeti, Himanshu Lodha, Aman Singh, Aditya Sagi, Shalabh Bhatnagar, Shishir Kolathaya
2022	J	`jnl`	Generalized Second-Order Value Iteration in Markov Decision Processes. IEEE Trans. Autom. Control. Chandramouli Kamanchi, Raghuram Bharadwaj Diddigi, Shalabh Bhatnagar
2022	J	`jnl`	Generalized Simultaneous Perturbation Stochastic Approximation with Reduced Estimator Bias. CoRR Shalabh Bhatnagar, Prashanth L. A.
2022	A*	`conf`	Gradient Temporal Difference with Momentum: Stability and Convergence. AAAI Rohan Deb, Shalabh Bhatnagar
2022	A*	`conf`	Model-based Safe Deep Reinforcement Learning via a Constrained Proximal Policy Optimization Algorithm. NeurIPS Ashish Kumar Jayant, Shalabh Bhatnagar
2022	J	`jnl`	Model-based Safe Deep Reinforcement Learning via a Constrained Proximal Policy Optimization Algorithm. CoRR Ashish Kumar Jayant, Shalabh Bhatnagar
2022	B	`conf`	Neural Network Compatible Off-Policy Natural Actor-Critic Algorithm. IJCNN Raghuram Bharadwaj Diddigi, Prateek Jain, Prabuchandran K. J., Shalabh Bhatnagar
2022	J	`jnl`	Reinforcement Learning for Task Specifications with Action-Constraints. CoRR Arun Raman, Keerthan Shagrithaya, Shalabh Bhatnagar
2022	—	`conf`	Robust Traffic Signal Timing Control using Multiagent Twin Delayed Deep Deterministic Policy Gradients. ICAART (2) Priya Shanmugasundaram, Shalabh Bhatnagar
2022	—	`conf`	Schedule Based Temporal Difference Algorithms. Allerton Rohan Deb, Meet Gandhi, Shalabh Bhatnagar
2021	J	`jnl`	Asynchronous Stochastic Approximations With Asymptotically Biased Errors and Deep Multiagent Learning. IEEE Trans. Autom. Control. Arunselvan Ramaswamy, Shalabh Bhatnagar, Daniel E. Quevedo
2021	A	`conf`	Attention Actor-Critic Algorithm for Multi-Agent Constrained Co-operative Reinforcement Learning. AAMAS P. Parnika, Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, Shalabh Bhatnagar
2021	J	`jnl`	Attention Actor-Critic algorithm for Multi-Agent Constrained Co-operative Reinforcement Learning. CoRR P. Parnika, Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, Shalabh Bhatnagar
2021	J	`jnl`	Dynamic Mirror Descent based Model Predictive Control for Accelerating Robot Learning. CoRR Utkarsh A. Mishra, Soumya R. Samineni, Prakhar Goel, Chandravaran Kunjeti, Himanshu Lodha, Aman Singh, Aditya Sagi, Shalabh Bhatnagar, Shishir Kolathaya
2021	J	`jnl`	Finite Horizon Q-learning: Stability, Convergence and Simulations. CoRR Vivek VP, Shalabh Bhatnagar
2021	J	`jnl`	Gradient Temporal Difference with Momentum: Stability and Convergence. CoRR Rohan Deb, Shalabh Bhatnagar
2021	J	`jnl`	Memory-Based Deep Reinforcement Learning for Obstacle Avoidance in UAV With Limited Environment Knowledge. IEEE Trans. Intell. Transp. Syst. Abhik Singla, Sindhu Padakandla, Shalabh Bhatnagar
2021	J	`jnl`	N-Timescale Stochastic Approximation: Stability and Convergence. CoRR Rohan Deb, Shalabh Bhatnagar
2021	J	`jnl`	Neural Network Compatible Off-Policy Natural Actor-Critic Algorithm. CoRR Raghuram Bharadwaj Diddigi, Prateek Jain, Prabuchandran K. J., Shalabh Bhatnagar
2021	J	`jnl`	Novel First Order Bayesian Optimization with an Application to Reinforcement Learning. Appl. Intell. Prabuchandran K. J., Santosh Penubothula, Chandramouli Kamanchi, Shalabh Bhatnagar
2021	J	`jnl`	On tight bounds for function approximation error in risk-sensitive reinforcement learning. Syst. Control. Lett. Prasenjit Karmakar, Shalabh Bhatnagar
2021	J	`jnl`	Schedule Based Temporal Difference Algorithms. CoRR Rohan Deb, Meet Gandhi, Shalabh Bhatnagar
2021	J	`jnl`	Stochastic Approximation With Iterate-Dependent Markov Noise Under Verifiable Conditions in Compact State Space With the Stability of Iterates Not Ensured. IEEE Trans. Autom. Control. Prasenjit Karmakar, Shalabh Bhatnagar
2020	A	`conf`	A Convergent Off-Policy Temporal Difference Algorithm. ECAI Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, Shalabh Bhatnagar
2020	J	`jnl`	A Stochastic Game Framework for Efficient Energy Management in Microgrid Networks. CoRR Shravan Nayak, Chanakya Ajit Ekbote, Annanya Pratap Singh Chauhan, Raghuram Bharadwaj Diddigi, Prishita Ray, Abhinava Sikdar, Sai Koti Reddy Danda, Shalabh Bhatnagar
2020	J	`jnl`	A reinforcement learning approach to hybrid control design. CoRR Meet Gandhi, Atreyee Kundu, Shalabh Bhatnagar
2020	J	`jnl`	Analysis of Stochastic Approximation Schemes With Set-Valued Maps in the Absence of a Stability Guarantee and Their Stabilization. IEEE Trans. Autom. Control. Vinayaka G. Yaji, Shalabh Bhatnagar
2020	B	`conf`	Deep Reinforcement Learning with Successive Over-Relaxation and its Application in Autoscaling Cloud Resources. IJCNN Indu John, Shalabh Bhatnagar
2020	J	`jnl`	Generalized Speedy Q-Learning. IEEE Control. Syst. Lett. Indu John, Chandramouli Kamanchi, Shalabh Bhatnagar
2020	A*	`conf`	Hierarchical Average Reward Policy Gradient Algorithms (Student Abstract). AAAI Akshay Dharmavaram, Matthew Riemer, Shalabh Bhatnagar
2020	J	`jnl`	Hindsight Experience Replay with Kronecker Product Approximate Curvature. CoRR Dhuruva Priyan G. M, Abhik Singla, Shalabh Bhatnagar
2020	B	`conf`	Learning Stable Manoeuvres in Quadruped Robots from Expert Demonstrations. RO-MAN Sashank Tirumala, Sagar Venkatesh Gubbi, Kartik Paigwar, Aditya Sagi, Ashish Joglekar, Shalabh Bhatnagar, Ashitava Ghosal, Bharadwaj Amrutur, Shishir Kolathaya
2020	J	`jnl`	Learning Stable Manoeuvres in Quadruped Robots from Expert Demonstrations. CoRR Sashank Tirumala, Sagar Venkatesh Gubbi, Kartik Paigwar, Aditya Sagi, Ashish Joglekar, Shalabh Bhatnagar, Ashitava Ghosal, Bharadwaj Amrutur, Shishir Kolathaya
2020	B	`conf`	Learning-Based Resource Allocation in Industrial IoT Systems. PIMRC Sindhu Padakandla, Shilpa Rao, Shalabh Bhatnagar
2020	J	`jnl`	Random Directions Stochastic Approximation With Deterministic Perturbations. IEEE Trans. Autom. Control. Prashanth L. A., Shalabh Bhatnagar, Nirav Bhavsar, Michael C. Fu, Steven I. Marcus
2020	J	`jnl`	Reinforcement learning algorithm for non-stationary environments. Appl. Intell. Sindhu Padakandla, Prabuchandran K. J., Shalabh Bhatnagar
2020	Misc	`conf`	Robust Quadrupedal Locomotion on Sloped Terrains: A Linear Policy Approach. CoRL Kartik Paigwar, Lokesh Krishna, Sashank Tirumala, Naman Khetan, Aditya Varma, Ashish Joglekar, Shalabh Bhatnagar, Ashitava Ghosal, Bharadwaj Amrutur, Shishir Kolathaya
2020	J	`jnl`	Robust Quadrupedal Locomotion on Sloped Terrains: A Linear Policy Approach. CoRR Kartik Paigwar, Lokesh Krishna, Sashank Tirumala, Naman Khetan, Aditya Sagi, Ashish Joglekar, Shalabh Bhatnagar, Ashitava Ghosal, Bharadwaj Amrutur, Shishir Kolathaya
2020	—	`conf`	Stochastic Game Frameworks for Efficient Energy Management in Microgrid Networks. ISGT-Europe Shravan Nayak, Chanakya Ajit Ekbote, Annanya Pratap Singh Chauhan, Raghuram Bharadwaj Diddigi, Prishita Ray, Abhinava Sikdar, Sai Koti Reddy Danda, Shalabh Bhatnagar
2020	J	`jnl`	Stochastic Recursive Inclusions in Two Timescales with Nonadditive Iterate-Dependent Markov Noise. Math. Oper. Res. Vinayaka G. Yaji, Shalabh Bhatnagar
2020	J	`jnl`	Successive Over-Relaxation ${Q}$ -Learning. IEEE Control. Syst. Lett. Chandramouli Kamanchi, Raghuram Bharadwaj Diddigi, Shalabh Bhatnagar
2019	J	`jnl`	A Convergent Off-Policy Temporal Difference Algorithm. CoRR Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, Shalabh Bhatnagar
2019	A	`conf`	Actor-Critic Algorithms for Constrained Multi-agent Reinforcement Learning. AAMAS Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, Prabuchandran K. J., Shalabh Bhatnagar
2019	J	`jnl`	Actor-Critic Algorithms for Constrained Multi-agent Reinforcement Learning. CoRR Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, Prabuchandran K. J., Shalabh Bhatnagar
2019	—	`conf`	An Adaptive and Incremental Approach to Quantile Estimation. CDC Ajin George Joseph, Shalabh Bhatnagar
2019	J	`jnl`	An Online Sample Based Method for Mode Estimation using ODE Analysis of Stochastic Approximation Algorithms. CoRR Chandramouli K, Raghuram Bharadwaj Diddigi, Prabuchandran K. J., Shalabh Bhatnagar
2019	J	`jnl`	An Online Sample-Based Method for Mode Estimation Using ODE Analysis of Stochastic Approximation Algorithms. IEEE Control. Syst. Lett. Chandramouli Kamanchi, Raghuram Bharadwaj Diddigi, Prabuchandran K. J., Shalabh Bhatnagar
2019	J	`jnl`	Design, Development and Experimental Realization of a Quadrupedal Research Platform: Stoch. CoRR Dhaivat Dholakiya, Shounak Bhattacharya, Ajay Gunalan, Abhik Singla, Shalabh Bhatnagar, Bharadwaj Amrutur, Ashitava Ghosal, Shishir Kolathaya
2019	—	`conf`	Efficient Adaptive Resource Provisioning for Cloud Applications using Reinforcement Learning. FAS*W@SASO/ICAC Indu John, Aiswarya Sreekantan, Shalabh Bhatnagar
2019	—	`conf`	Efficient Budget Allocation and Task Assignment in Crowdsourcing. COMAD/CODS Indu John, Shalabh Bhatnagar
2019	J	`jnl`	Gait Library Synthesis for Quadruped Robots via Augmented Random Search. CoRR Sashank Tirumala, Aditya Sagi, Kartik Paigwar, Ashish Joglekar, Shalabh Bhatnagar, Ashitava Ghosal, Bharadwaj Amrutur, Shishir Kolathaya
2019	J	`jnl`	Generalized Speedy Q-learning. CoRR Indu John, Chandramouli Kamanchi, Shalabh Bhatnagar
2019	J	`jnl`	Hierarchical Average Reward Policy Gradient Algorithms. CoRR Akshay Dharmavaram, Matthew Riemer, Shalabh Bhatnagar
2019	B	`conf`	Learning Active Spine Behaviors for Dynamic and Efficient Locomotion in Quadruped Robots. RO-MAN Shounak Bhattacharya, Abhik Singla, Abhimanyu, Dhaivat Dholakiya, Shalabh Bhatnagar, Bharadwaj Amrutur, Ashitava Ghosal, Shishir Kolathaya
2019	J	`jnl`	Learning Active Spine Behaviors for Dynamic and Efficient Locomotion in Quadruped Robots. CoRR Shounak Bhattacharya, Abhik Singla, Abhimanyu, Dhaivat Dholakiya, Shalabh Bhatnagar, Bharadwaj Amrutur, Ashitava Ghosal, Shishir Kolathaya
2019	C	`conf`	Predictive and Prescriptive Analytics for Performance Optimization: Framework and a Case Study on a Large-Scale Enterprise System. ICMLA Indu John, Ravikumar Karumanchi, Shalabh Bhatnagar
2019	A*	`conf`	Realizing Learned Quadruped Locomotion Behaviors through Kinematic Motion Primitives. ICRA Abhik Singla, Shounak Bhattacharya, Dhaivat Dholakiya, Shalabh Bhatnagar, Ashitava Ghosal, Bharadwaj Amrutur, Shishir Kolathaya
2019	J	`jnl`	Reinforcement Learning in Non-Stationary Environments. CoRR Sindhu Padakandla, Prabuchandran K. J., Shalabh Bhatnagar
2019	J	`jnl`	Second Order Value Iteration in Reinforcement Learning. CoRR Chandramouli Kamanchi, Raghuram Bharadwaj Diddigi, Shalabh Bhatnagar
2019	J	`jnl`	Solution of Two-Player Zero-Sum Game by Successive Relaxation. CoRR Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, Shalabh Bhatnagar
2019	J	`jnl`	Stability of Stochastic Approximations With "Controlled Markov" Noise and Temporal Difference Learning. IEEE Trans. Autom. Control. Arunselvan Ramaswamy, Shalabh Bhatnagar
2019	—	`conf`	Stochastic Approximation Trackers for Model-Based Search. Allerton Ajin George Joseph, Shalabh Bhatnagar
2019	J	`jnl`	Successive Over Relaxation Q-Learning. CoRR Chandramouli Kamanchi, Raghuram Bharadwaj Diddigi, Shalabh Bhatnagar
2019	B	`conf`	Trajectory based Deep Policy Search for Quadrupedal Walking. RO-MAN Shishir Kolathaya, Ashitava Ghosal, Bharadwaj Amrutur, Ashish Joglekar, Suhan Shetty, Dhaivat Dholakiya, Abhimanyu, Aditya Sagi, Shounak Bhattacharya, Abhik Singla, Shalabh Bhatnagar
2018	J	`jnl`	A Cross Entropy based Optimization Algorithm with Global Convergence Guarantees. CoRR Ajin George Joseph, Shalabh Bhatnagar
2018	J	`jnl`	A Linearly Relaxed Approximate Linear Program for Markov Decision Processes. IEEE Trans. Autom. Control. Chandrashekar Lakshminarayanan, Shalabh Bhatnagar, Csaba Szepesvári
2018	J	`jnl`	A stochastic approximation approach to active queue management. Telecommun. Syst. Shalabh Bhatnagar, Sanjeev Patel, Karmeshu
2018	—	`conf`	A unified decision making framework for supply and demand management in microgrid networks. SmartGridComm Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, Shalabh Bhatnagar
2018	J	`jnl`	An Incremental Off-policy Search in a Model-free Markov Decision Process Using a Single Sample Path. CoRR Ajin George Joseph, Shalabh Bhatnagar
2018	J	`jnl`	An Online Prediction Algorithm for Reinforcement Learning with Linear Function Approximation using Cross Entropy Method. CoRR Ajin George Joseph, Shalabh Bhatnagar
2018	J	`jnl`	An incremental off-policy search in a model-free Markov decision process using a single sample path. Mach. Learn. Ajin George Joseph, Shalabh Bhatnagar
2018	J	`jnl`	An online prediction algorithm for reinforcement learning with linear function approximation using cross entropy method. Mach. Learn. Ajin George Joseph, Shalabh Bhatnagar
2018	J	`jnl`	Analysis of Gradient Descent Methods With Nondiminishing Bounded Errors. IEEE Trans. Autom. Control. Arunselvan Ramaswamy, Shalabh Bhatnagar
2018	—	`conf`	Generalized Deterministic Perturbations For Stochastic Gradient Search. CDC Chandramouli K, Prabuchandran K. J., Sai Koti Reddy Danda, Shalabh Bhatnagar
2018	J	`jnl`	Gradient-Based Adaptive Stochastic Search for Simulation Optimization Over Continuous Space. INFORMS J. Comput. Enlu Zhou, Shalabh Bhatnagar
2018	J	`jnl`	Memory-based Deep Reinforcement Learning for Obstacle Avoidance in UAV with Limited Environment Knowledge. CoRR Abhik Singla, Sindhu Padakandla, Shalabh Bhatnagar
2018	J	`jnl`	Novel Sensor Scheduling Scheme for Intruder Tracking in Energy Efficient Sensor Networks. IEEE Wirel. Commun. Lett. Raghuram Bharadwaj Diddigi, Prabuchandran K. J., Shalabh Bhatnagar
2018	J	`jnl`	Random directions stochastic approximation with deterministic perturbations. CoRR Prashanth L. A., Shalabh Bhatnagar, Nirav Bhavsar, Michael C. Fu, Steven I. Marcus
2018	J	`jnl`	Realizing Learned Quadruped Locomotion Behaviors through Kinematic Motion Primitives. CoRR Abhik Singla, Shounak Bhattacharya, Dhaivat Dholakiya, Shalabh Bhatnagar, Ashitava Ghosal, Bharadwaj Amrutur, Shishir Kolathaya
2018	J	`jnl`	Two Time-Scale Stochastic Approximation with Controlled Markov Noise and Off-Policy Temporal-Difference Learning. Math. Oper. Res. Prasenjit Karmakar, Shalabh Bhatnagar
2017	J	`jnl`	A Generalization of the Borkar-Meyn Theorem for Stochastic Recursive Inclusions. Math. Oper. Res. Arunselvan Ramaswamy, Shalabh Bhatnagar
2017	J	`jnl`	A Linearly Relaxed Approximate Linear Program for Markov Decision Processes. CoRR Chandrashekar Lakshminarayanan, Shalabh Bhatnagar, Csaba Szepesvári
2017	B	`conf`	A model based search method for prediction in model-free Markov decision process. IJCNN Ajin George Joseph, Shalabh Bhatnagar
2017	J	`jnl`	A stability criterion for two timescale stochastic approximation schemes. Autom. Chandrashekar Lakshminarayanan, Shalabh Bhatnagar
2017	J	`jnl`	A unified decision making framework for supply and demand management in microgrid networks. CoRR Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, Krishnasuri Narayanam, Shalabh Bhatnagar
2017	J	`jnl`	Adaptive System Optimization Using Random Directions Stochastic Approximation. IEEE Trans. Autom. Control. Prashanth L. A., Shalabh Bhatnagar, Michael C. Fu, Steven I. Marcus
2017	J	`jnl`	Adaptive mean queue size and its rate of change: queue management with random dropping. Telecommun. Syst. Karmeshu, Sanjeev Patel, Shalabh Bhatnagar
2017	—	`conf`	An Incremental Fast Policy Search Using a Single Sample Path. PReMI Ajin George Joseph, Shalabh Bhatnagar
2017	J	`jnl`	Analysis of stochastic approximation schemes with set-valued maps in the absence of a stability guarantee and their stabilization. CoRR Vinayaka G. Yaji, Shalabh Bhatnagar
2017	B	`conf`	Bounds for off-policy prediction in reinforcement learning. IJCNN Ajin George Joseph, Shalabh Bhatnagar
2017	J	`jnl`	Conditions for Stability and Convergence of Set-Valued Stochastic Approximations: Applications to Approximate Value and Fixed point Iterations with Noise. CoRR Arunselvan Ramaswamy, Shalabh Bhatnagar
2017	J	`jnl`	Deterministic Perturbations For Simultaneous Perturbation Methods Using Circulant Matrices. CoRR Chandramouli K, Sai Koti Reddy Danda, Shalabh Bhatnagar
2017	J	`jnl`	Multi-Agent Q-Learning for Minimizing Demand-Supply Power Deficit in Microgrids. CoRR Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, Shalabh Bhatnagar
2017	J	`jnl`	Novel Sensor Scheduling Scheme for Intruder Tracking in Energy Efficient Sensor Networks. CoRR Raghuram Bharadwaj Diddigi, Prabuchandran K. J., Shalabh Bhatnagar
2017	J	`jnl`	Quasi-Newton smoothed functional algorithms for unconstrained and constrained simulation optimization. Comput. Optim. Appl. K. Lakshmanan, Shalabh Bhatnagar
2017	J	`jnl`	RLWS: A Reinforcement Learning based GPU Warp Scheduler. CoRR Jayvant Anantpur, Nagendra Dwarakanath Gulur, Shivaram Kalyanakrishnan, Shalabh Bhatnagar, R. Govindarajan
2017	B	`conf`	Scalable Performance Tuning of Hadoop MapReduce: A Noisy Gradient Approach. CLOUD Sandeep Kumar, Sindhu Padakandla, Chandrashekar Lakshminarayanan, Priyank Parihar, K. Gopinath, Shalabh Bhatnagar
2016	J	`jnl`	A Cross Entropy based Stochastic Approximation Algorithm for Reinforcement Learning with Linear Function Approximation. CoRR Ajin George Joseph, Shalabh Bhatnagar
2016	J	`jnl`	A constrained optimization perspective on actor-critic algorithms and application to network routing. Syst. Control. Lett. Prashanth L. A., H. L. Prasad, Shalabh Bhatnagar, Prakash Chandra
2016	J	`jnl`	A note on the function approximation error bound for risk-sensitive reinforcement learning. CoRR Prasenjit Karmakar, Shalabh Bhatnagar
2016	Misc	`conf`	A randomized algorithm for continuous optimization. WSC Ajin George Joseph, Shalabh Bhatnagar
2016	J	`jnl`	Actor-Critic Algorithms with Online Feature Adaptation. ACM Trans. Model. Comput. Simul. Prabuchandran K. J., Shalabh Bhatnagar, Vivek S. Borkar
2016	J	`jnl`	Adaptive Mean Queue Size and Its Rate of Change: Queue Management with Random Dropping. CoRR Karmeshu, Sanjeev Patel, Shalabh Bhatnagar
2016	J	`jnl`	Gradient-based learning algorithms with constant-error estimators: stability and convergence. CoRR Arunselvan Ramaswamy, Shalabh Bhatnagar
2016	—	`conf`	Improved Hessian estimation for adaptive random directions stochastic approximation. CDC Sai Koti Reddy Danda, Prashanth L. A., Shalabh Bhatnagar
2016	J	`jnl`	Multiscale Q-learning with linear function approximation. Discret. Event Dyn. Syst. Shalabh Bhatnagar, K. Lakshmanan
2016	J	`jnl`	On a convergent off -policy temporal difference learning algorithm in on-line learning environment. CoRR Prasenjit Karmakar, Raj Kumar Maity, Shalabh Bhatnagar
2016	J	`jnl`	Performance Tuning of Hadoop MapReduce: A Noisy Gradient Approach. CoRR Sandeep Kumar, Sindhu Padakandla, Chandrashekar Lakshminarayanan, Priyank Parihar, K. Gopinath, Shalabh Bhatnagar
2016	A	`conf`	Revisiting the Cross Entropy Method with Applications in Stochastic Global Optimization and Reinforcement Learning. ECAI Ajin George Joseph, Shalabh Bhatnagar
2016	B	`conf`	Scalable focussed entity resolution. IJCNN Ranganath B. N., Shalabh Bhatnagar
2016	A	`conf`	Shaping Proto-Value Functions Using Rewards. ECAI Raj Kumar Maity, Chandrashekar Lakshminarayanan, Sindhu Padakandla, Shalabh Bhatnagar
2016	J	`jnl`	Stochastic Recursive Inclusions in two timescales with non-additive iterate dependent Markov noise. CoRR Vinayaka Yaji, Shalabh Bhatnagar
2016	J	`jnl`	Stochastic Recursive Inclusions with Non-Additive Iterate-Dependent Markov Noise. CoRR Vinayaka Yaji, Shalabh Bhatnagar
2015	J	`jnl`	A Generalization of the Borkar-Meyn Theorem for Stochastic Recursive Inclusions. CoRR Arunselvan Ramaswamy, Shalabh Bhatnagar
2015	A*	`conf`	A Generalized Reduced Linear Program for Markov Decision Processes. AAAI Chandrashekar Lakshminarayanan, Shalabh Bhatnagar
2015	—	`conf`	A Stochastic Approximation Algorithm for Quantile Estimation. ICONIP (2) Ajin George Joseph, Shalabh Bhatnagar
2015	J	`jnl`	A Study of Gradient Descent Schemes for General-Sum Stochastic Games. CoRR H. L. Prasad, Shalabh Bhatnagar
2015	J	`jnl`	A bi-convex optimization problem to compute Nash equilibrium in n-player games and an algorithm. CoRR Vinayaka Yaji, Shalabh Bhatnagar
2015	J	`jnl`	A constrained optimization perspective on actor critic algorithms and application to network routing. CoRR Prashanth L. A., H. L. Prasad, Shalabh Bhatnagar, Prakash Chandra
2015	J	`jnl`	Adaptive system optimization using (simultaneous) random directions stochastic approximation. CoRR Prashanth L. A., Shalabh Bhatnagar
2015	Misc	`conf`	Decentralized learning for traffic signal control. COMSNETS Prabuchandran K. J., Hemanth Kumar A. N, Shalabh Bhatnagar
2015	J	`jnl`	Energy Sharing for Multiple Sensor Nodes With Finite Buffers. IEEE Trans. Commun. Sindhu Padakandla, Prabuchandran K. J., Shalabh Bhatnagar
2015	J	`jnl`	Energy Sharing for Multiple Sensor Nodes with Finite Buffers. CoRR Sindhu Padakandla, Prabuchandran K. J., Shalabh Bhatnagar
2015	J	`jnl`	Necessary and sufficient conditions for optimality in constrained general sum stochastic games. Syst. Control. Lett. Vinayaka Yaji, Shalabh Bhatnagar
2015	J	`jnl`	Shaping Proto-Value Functions via Rewards. CoRR Chandrashekar Lakshmi Narayanan, Raj Kumar Maity, Shalabh Bhatnagar
2015	J	`jnl`	Simultaneous Perturbation Newton Algorithms for Simulation Optimization. J. Optim. Theory Appl. Shalabh Bhatnagar, Prashanth L. A.
2015	J	`jnl`	Simultaneous perturbation methods for adaptive labor staffing in service systems. Simul. Prashanth L. A., H. L. Prasad, Nirmit Desai, Shalabh Bhatnagar, Gargi Dasgupta
2015	J	`jnl`	Stability of Stochastic Approximations with 'Controlled Markov' Noise and Temporal Difference Learning. CoRR Arunselvan Ramaswamy, Shalabh Bhatnagar
2015	J	`jnl`	Stochastic recursive inclusions with two timescales. CoRR Arunselvan Ramaswamy, Shalabh Bhatnagar
2015	J	`jnl`	Two Timescale Stochastic Approximation with Controlled Markov noise. CoRR Prasenjit Karmakar, Shalabh Bhatnagar
2015	A	`conf`	Two-Timescale Algorithms for Learning Nash Equilibria in General-Sum Stochastic Games. AAMAS H. L. Prasad, Prashanth L. A., Shalabh Bhatnagar
2014	J	`jnl`	A Generalized Reduced Linear Program for Markov Decision Processes. CoRR Chandrashekar Lakshminarayanan, Shalabh Bhatnagar
2014	B	`conf`	A Markov Decision Process Framework for Predictable Job Completion Times on Crowdsourcing Platforms. HCOMP Chandrashekar Lakshminarayanan, Ayush Dubey, Shalabh Bhatnagar, Chithralekha Balamurugan
2014	J	`jnl`	A simulation-based algorithm for optimal pricing policy under demand uncertainty. Int. Trans. Oper. Res. Saswata Chakravarty, Sindhu Padakandla, Shalabh Bhatnagar
2014	Misc	`conf`	Adaptive sleep-wake control using reinforcement learning in sensor networks. COMSNETS Prashanth L. A., Abhranil Chatterjee, Shalabh Bhatnagar
2014	J	`jnl`	Algorithms for Nash Equilibria in General-Sum Stochastic Games. CoRR H. L. Prasad, Prashanth L. A., Shalabh Bhatnagar
2014	—	`conf`	An actor critic algorithm based on Grassmanian search. CDC Prabuchandran K. J., Shalabh Bhatnagar, Vivek S. Borkar
2014	J	`jnl`	Approximate Dynamic Programming based on Projection onto the (min, +) subsemimodule. CoRR Chandrashekar Lakshminarayanan, Shalabh Bhatnagar
2014	—	`conf`	Approximate Dynamic Programming with (min; +) linear function approximation for Markov decision processes. CDC Chandrashekar Lakshminarayanan, Shalabh Bhatnagar
2014	J	`jnl`	Approximate dynamic programming with $(\min, +)$ linear function approximation for Markov decision processes. CoRR Chandrashekar Lakshminarayanan, Shalabh Bhatnagar
2014	—	`conf`	Multi-agent reinforcement learning for traffic signal control. ITSC Prabuchandran K. J., Hemanth Kumar A. N, Shalabh Bhatnagar
2014	J	`jnl`	Newton-based stochastic optimization using q-Gaussian smoothed functional algorithms. Autom. Debarghya Ghoshdastidar, Ambedkar Dukkipati, Shalabh Bhatnagar
2014	Misc	`conf`	Simulation optimization via gradient-based stochastic search. WSC Enlu Zhou, Shalabh Bhatnagar, Xi Chen
2014	J	`jnl`	Smoothed Functional Algorithms for Stochastic Optimization Using ACM Trans. Model. Comput. Simul. Debarghya Ghoshdastidar, Ambedkar Dukkipati, Shalabh Bhatnagar
2014	J	`jnl`	Two timescale convergent Q-learning for sleep-scheduling in wireless sensor networks. Wirel. Networks Prashanth L. A., Abhranil Chatterjee, Shalabh Bhatnagar
2014	—	`conf`	Universal Option Models. NIPS Hengshuai Yao, Csaba Szepesvári, Richard S. Sutton, Joseph Modayil, Shalabh Bhatnagar
2013	J	`jnl`	Feature Search in the Grassmanian in Online Reinforcement Learning. IEEE J. Sel. Top. Signal Process. Shalabh Bhatnagar, Vivek S. Borkar, Prabuchandran K. J.
2013	A	`conf`	Mechanisms for hostile agents with capacity constraints. AAMAS Prashanth Lakshmanrao Ananthapadmanabharao, Horabailu Laxminarayana Prasad, Nirmit Desai, Shalabh Bhatnagar
2013	J	`jnl`	Newton based Stochastic Optimization using q-Gaussian Smoothed Functional Algorithms. CoRR Debarghya Ghoshdastidar, Ambedkar Dukkipati, Shalabh Bhatnagar
2013	J	`jnl`	Q-Learning Based Energy Management Policies for a Single Sensor Node with Finite Buffer. IEEE Wirel. Commun. Lett. Prabuchandran K. J., Sunil Kumar Meena, Shalabh Bhatnagar
2013	J	`jnl`	Reinforcement Learning for Sleep-Wake Scheduling in Sensor Networks. CoRR Prashanth Lakshmanrao Ananthapadmanabharao, Abhranil Chatterjee, Shalabh Bhatnagar
2013	J	`jnl`	Simultaneous Perturbation Methods for Adaptive Labor Staffing in Service Systems. CoRR Prashanth L. A., H. L. Prasad, Nirmit Desai, Shalabh Bhatnagar, Gargi Dasgupta
2012	—	`conf`	A novel Q-learning algorithm with function approximation for constrained Markov decision processes. Allerton Conference K. Lakshmanan, Shalabh Bhatnagar
2012	J	`jnl`	An Online Actor-Critic Algorithm with Function Approximation for Constrained Markov Decision Processes. J. Optim. Theory Appl. Shalabh Bhatnagar, K. Lakshmanan
2012	J	`jnl`	General-sum stochastic games: Verifiability conditions for Nash equilibria. Autom. H. L. Prasad, Shalabh Bhatnagar
2012	J	`jnl`	Optimal multi-layered congestion based pricing schemes for enhanced QoS. Comput. Networks Koteswara Rao Vemu, Shalabh Bhatnagar, N. Hemachandra
2012	J	`jnl`	Smoothed Functional Algorithms for Stochastic Optimization using q-Gaussian Distributions. CoRR Debarghya Ghoshdastidar, Ambedkar Dukkipati, Shalabh Bhatnagar
2012	J	`jnl`	Threshold Tuning Using Stochastic Optimization for Graded Signal Control. IEEE Trans. Veh. Technol. Prashanth L. A., Shalabh Bhatnagar
2012	J	`jnl`	q-Gaussian based Smoothed Functional Algorithm for Stochastic Optimization CoRR Debarghya Ghoshdastidar, Ambedkar Dukkipati, Shalabh Bhatnagar
2012	B	`conf`	q-Gaussian based Smoothed Functional algorithms for stochastic optimization. ISIT Debarghya Ghoshdastidar, Ambedkar Dukkipati, Shalabh Bhatnagar
2011	J	`jnl`	An Optimized SDE Model for Slotted Aloha. IEEE Trans. Commun. Karmeshu, Shalabh Bhatnagar, Vivek Kumar Mishra
2011	J	`jnl`	Reinforcement Learning With Function Approximation for Traffic Signal Control. IEEE Trans. Intell. Transp. Syst. Prashanth L. A., Shalabh Bhatnagar
2011	—	`conf`	Reinforcement learning with average cost for adaptive control of traffic lights at intersections. ITSC Prashanth L. A., Shalabh Bhatnagar
2011	Misc	`conf`	Smoothed Functional and Quasi-Newton Algorithms for Routing in Multi-stage Queueing Network with Constraints. ICDCIT K. Lakshmanan, Shalabh Bhatnagar
2011	J	`jnl`	Stochastic Algorithms for Discrete Parameter Simulation Optimization. IEEE Trans Autom. Sci. Eng. Shalabh Bhatnagar, Vivek Kumar Mishra, N. Hemachandra
2011	A	`conf`	Stochastic Optimization for Adaptive Labor Staffing in Service Systems. ICSOC Prashanth L. A., H. L. Prasad, Nirmit Desai, Shalabh Bhatnagar, Gargi Banerjee Dasgupta
2011	J	`jnl`	Stochastic approximation algorithms for constrained optimization via simulation. ACM Trans. Model. Comput. Simul. Shalabh Bhatnagar, N. Hemachandra, Vivek Kumar Mishra
2011	J	`jnl`	The Borkar-Meyn theorem for asynchronous stochastic approximations. Syst. Control. Lett. Shalabh Bhatnagar
2010	J	`jnl`	An actor-critic algorithm with function approximation for discounted cost constrained Markov decision processes. Syst. Control. Lett. Shalabh Bhatnagar
2010	J	`jnl`	An efficient algorithm for scheduling in bluetooth piconets and scatternets. Wirel. Networks G. Ramana Reddy, Shalabh Bhatnagar, V. Rakesh, Vijay Prakash Chaturvedi
2010	J	`jnl`	Optimized Policies for the Retransmission Probabilities in Slotted Aloha. Simul. Anshuk Chakraborty, Shalabh Bhatnagar
2010	A*	`conf`	Toward Off-Policy Learning Control with Function Approximation. ICML Hamid Reza Maei, Csaba Szepesvári, Shalabh Bhatnagar, Richard S. Sutton
2009	J	`jnl`	A probabilistic constrained nonlinear optimization framework to optimize RED parameters. Perform. Evaluation Rajesh Kumar Patro, Shalabh Bhatnagar
2009	J	`jnl`	A proof of convergence of the B-RED and P-RED algorithms for random early detection. IEEE Commun. Lett. Shalabh Bhatnagar, Rajesh Kumar Patro
2009	—	`conf`	Convergent Temporal-Difference Learning with Arbitrary Smooth Function Approximation. NIPS Hamid Reza Maei, Csaba Szepesvári, Shalabh Bhatnagar, Doina Precup, David Silver, Richard S. Sutton
2009	A*	`conf`	Fast gradient-descent methods for temporal-difference learning with linear function approximation. ICML Richard S. Sutton, Hamid Reza Maei, Doina Precup, Shalabh Bhatnagar, David Silver, Csaba Szepesvári, Eric Wiewiora
2009	—	`conf`	LMS-2: Towards an algorithm that is as cheap as LMS and almost as efficient as RLS. CDC Hengshuai Yao, Shalabh Bhatnagar, Csaba Szepesvári
2009	—	`conf`	Multi-Step Dyna Planning for Policy Evaluation and Control. NIPS Hengshuai Yao, Richard S. Sutton, Shalabh Bhatnagar, Diao Dongcui, Csaba Szepesvári
2009	J	`jnl`	Natural actor-critic algorithms. Autom. Shalabh Bhatnagar, Richard S. Sutton, Mohammad Ghavamzadeh, Mark Lee
2009	J	`jnl`	Optimal parameter trajectory estimation in parameterized SDEs: An algorithmic procedure. ACM Trans. Model. Comput. Simul. Shalabh Bhatnagar, Karmeshu, Vivek Kumar Mishra
2009	—	`ch.`	Pattern Synthesis for Nonparametric Pattern Recognition. Encyclopedia of Data Warehousing and Mining P. Viswanath, M. Narasimha Murty, Shalabh Bhatnagar
2008	J	`jnl`	An efficient ad recommendation system for TV programs. Multim. Syst. Sudha Velusamy, Lakshmi Gopal, Shalabh Bhatnagar, Sridhar Varadarajan
2008	—	`conf`	Ant Colony Optimization Algorithms for Shortest Path Problems. NET-COOP Sudha Rani Kolavali, Shalabh Bhatnagar
2008	J	`jnl`	New algorithms of the Q-learning type. Autom. Shalabh Bhatnagar, K. Mohan Babu
2008	C	`conf`	SPSA based feature relevance estimation for video retrieval. MMSP Sudha Velusamy, Shalabh Bhatnagar, S. V. Basavaraja, V. Sridhar
2008	J	`jnl`	Simulation-Based Optimization Algorithms for Finite-Horizon Markov Decision Processes. Simul. Shalabh Bhatnagar, Mohammed Shahid Abdulla
2007	J	`jnl`	Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization. ACM Trans. Model. Comput. Simul. Shalabh Bhatnagar
2007	Misc	`conf`	An Efficient and Optimized Bluetooth Scheduling Algorithm for Piconets. ICDCIT Vijay Prakash Chaturvedi, V. Rakesh, Shalabh Bhatnagar
2007	Misc	`conf`	An Optimal Weighted-Average Congestion Based Pricing Scheme for Enhanced QoS. ICDCIT Koteswara Rao Vemu, Shalabh Bhatnagar, N. Hemachandra
2007	—	`conf`	Discrete parameter simulation optimization algorithms with applications to admission control with dependent service times. CDC Vivek Kumar Mishra, Shalabh Bhatnagar, N. Hemachandra
2007	—	`conf`	Fuzzy Clustering Based Ad Recommendation for TV Programs. EuroITV Sudha Velusamy, Lakshmi Gopal, Sridhar Varadarajan, Shalabh Bhatnagar
2007	J	`jnl`	Gelfand-Yaglom-Perez theorem for generalized relative entropy functionals. Inf. Sci. Ambedkar Dukkipati, Shalabh Bhatnagar, M. Narasimha Murty
2007	—	`conf`	Incremental Natural Actor-Critic Algorithms. NIPS Shalabh Bhatnagar, Richard S. Sutton, Mohammad Ghavamzadeh, Mark Lee
2007	—	`conf`	Link route pricing for enhanced QoS. CDC Koteswara Rao Vemu, Shalabh Bhatnagar, N. Hemachandra
2007	—	`conf`	Network flow-control using asynchronous stochastic approximation. CDC Mohammed Shahid Abdulla, Shalabh Bhatnagar
2007	C	`conf`	Parametrized Actor-Critic Algorithms for Finite-Horizon MDPs. ACC Mohammed Shahid Abdulla, Shalabh Bhatnagar
2007	J	`jnl`	Reinforcement Learning Based Algorithms for Average Cost Markov Decision Processes. Discret. Event Dyn. Syst. Mohammed Shahid Abdulla, Shalabh Bhatnagar
2007	C	`conf`	Solving MDPs using Two-timescale Simulated Annealing with Multiplicative Weights. ACC Mohammed Shahid Abdulla, Shalabh Bhatnagar
2006	—	`conf`	A Four-Timescale Algorithm for Constrained Stochastic Optimization of RED. CDC Rajesh Kumar Patro, Shalabh Bhatnagar
2006	—	`conf`	A Reinforcement Learning Based Algorithm for Finite Horizon Markov Decision Processes. CDC Shalabh Bhatnagar, Mohammed Shahid Abdulla
2006	J	`jnl`	A Simulation-Based Algorithm for Ergodic Control of Markov Chains Conditioned on Rare Events. J. Mach. Learn. Res. Shalabh Bhatnagar, Vivek S. Borkar, Madhukar Akarapu
2006	J	`jnl`	Actor-critic algorithms for hierarchical Markov decision processes. Autom. Shalabh Bhatnagar, J. Ranjan Panigrahi
2006	J	`jnl`	On Measure Theoretic definitions of Generalized Information Measures and Maximum Entropy Prescriptions CoRR Ambedkar Dukkipati, M. Narasimha Murty, Shalabh Bhatnagar
2006	J	`jnl`	Partition based pattern synthesis technique with efficient algorithms for nearest neighbor classification. Pattern Recognit. Lett. P. Viswanath, M. Narasimha Murty, Shalabh Bhatnagar
2006	J	`jnl`	Robust optimization of Random Early Detection. Telecommun. Syst. Rahul Vaidya, Shalabh Bhatnagar
2006	Misc	`conf`	SPSA algorithms with measurement reuse. WSC Mohammed Shahid Abdulla, Shalabh Bhatnagar
2005	J	`jnl`	A Discrete Parameter Stochastic Approximation Algorithm for Simulation Optimization. Simul. Shalabh Bhatnagar, Hemant J. Kowshik
2005	J	`jnl`	Adaptive multivariate three-timescale stochastic approximation algorithms for simulation based optimization. ACM Trans. Model. Comput. Simul. Shalabh Bhatnagar
2005	B	`conf`	Information theoretic justification of Boltzmann selection and its generalization to Tsallis case. Congress on Evolutionary Computation Ambedkar Dukkipati, M. Narasimha Murty, Shalabh Bhatnagar
2005	J	`jnl`	Optimal Threshold Policies for Admission Control in Communication Networks via Discrete Parameter Stochastic Approximation. Telecommun. Syst. Shalabh Bhatnagar, I. Bala Bhaskar Reddy
2005	J	`jnl`	Overlap pattern synthesis with an efficient nearest neighbor classifier. Pattern Recognit. P. Viswanath, M. Narasimha Murty, Shalabh Bhatnagar
2005	B	`conf`	Properties of Kullback-Leibler cross-entropy minimization in nonextensive framework. ISIT Ambedkar Dukkipati, Narasimha Murty Musti, Shalabh Bhatnagar
2005	Misc	`conf`	Solution of Mdps Using Simulation-Based Value Iteration. AIAI Mohammed Shahid Abdulla, Shalabh Bhatnagar
2005	J	`jnl`	Uniqueness of Nonextensive entropy under Renyi's Recipe CoRR Ambedkar Dukkipati, M. Narasimha Murty, Shalabh Bhatnagar
2004	—	`conf`	A Pattern Synthesis Technique with an Efficient Nearest Neighbor Classifier for Binary Pattern Recognition. ICPR (4) P. Viswanath, M. Narasimha Murty, Shalabh Bhatnagar
2004	J	`jnl`	A simultaneous perturbation stochastic approximation-based actor-critic algorithm for Markov decision processes. IEEE Trans. Autom. Control. Shalabh Bhatnagar, Shishir Kumar
2004	J	`jnl`	Cauchy Annealing Schedule: An Annealing Schedule for Boltzmann Selection Scheme in Evolutionary Algorithms CoRR Ambedkar Dukkipati, M. Narasimha Murty, Shalabh Bhatnagar
2004	B	`conf`	Cauchy annealing schedule: an annealing schedule for Boltzmann selection scheme in evolutionary algorithms. IEEE Congress on Evolutionary Computation Ambedkar Dukkipati, M. Narasimha Murty, Shalabh Bhatnagar
2004	J	`jnl`	Fusion of multiple approximate nearest neighbor classifiers for fast and efficient classification. Inf. Fusion P. Viswanath, M. Narasimha Murty, Shalabh Bhatnagar
2004	J	`jnl`	Generalized Evolutionary Algorithm based on Tsallis Statistics CoRR Ambedkar Dukkipati, M. Narasimha Murty, Shalabh Bhatnagar
2004	—	`conf`	Hierarchical decision making in semiconductor fabs using multi-time scale Markov decision processes. CDC Jnana Ranjan Panigrahi, Shalabh Bhatnagar
2003	J	`jnl`	Multiscale Chaotic SPSA and Smoothed Functional Algorithms for Simulation Optimization. Simul. Shalabh Bhatnagar, Vivek S. Borkar
2003	B	`conf`	Quotient evolutionary space: abstraction of evolutionary process w.r.t macroscopic properties. IEEE Congress on Evolutionary Computation Ambedkar Dukkipati, M. Narasimha Murty, Shalabh Bhatnagar
2003	J	`jnl`	Two-timescale simultaneous perturbation stochastic approximation using deterministic perturbation sequences. ACM Trans. Model. Comput. Simul. Shalabh Bhatnagar, Michael C. Fu, Steven I. Marcus, I-Jeng Wang
2002	J	`jnl`	A time aggregation approach to Markov decision processes. Autom. Xi-Ren Cao, Zhiyuan Ren, Shalabh Bhatnagar, Michael C. Fu, Steven I. Marcus
2001	J	`jnl`	Optimal structured feedback policies for ABR flow control using two-timescale SPSA. IEEE/ACM Trans. Netw. Shalabh Bhatnagar, Michael C. Fu, Steven I. Marcus, Pedram Jaefari Fard
1995	J	`jnl`	A Convex Analytic Framework for Ergodic Control of Semi-Markov Processes. Math. Oper. Res. Shalabh Bhatnagar, Vivek S. Borkar