| 2005 | A New Perspective on an Old Perceptron Algorithm. Shai Shalev-Shwartz, Yoram Singer |
| 2005 | A PAC-Style Model for Learning from Labeled and Unlabeled Data. Maria-Florina Balcan, Avrim Blum |
| 2005 | Analysis of Perceptron-Based Active Learning. Sanjoy Dasgupta, Adam Tauman Kalai, Claire Monteleoni |
| 2005 | Approximating a Gram Matrix for Improved Kernel-Based Learning. Petros Drineas, Michael W. Mahoney |
| 2005 | Asymptotic Log-Loss of Prequential Maximum Likelihood Codes. Peter Grünwald, Steven de Rooij |
| 2005 | Competitive Collaborative Learning. Baruch Awerbuch, Robert D. Kleinberg |
| 2005 | Compute Inclusion Depth of a Pattern. Wei Luo |
| 2005 | Data Dependent Concentration Bounds for Sequential Prediction Algorithms. Tong Zhang |
| 2005 | Ellipsoid Approximation Using Random Vectors. Shahar Mendelson, Alain Pajor |
| 2005 | Exponential Convergence Rates in Classification. Vladimir Koltchinskii, Olexandra Beznosova |
| 2005 | Fast Rates for Support Vector Machines. Ingo Steinwart, Clint Scovel |
| 2005 | From External to Internal Regret. Avrim Blum, Yishay Mansour |
| 2005 | From Graphs to Manifolds - Weak and Strong Pointwise Consistency of Graph Laplacians. Matthias Hein, Jean-Yves Audibert, Ulrike von Luxburg |
| 2005 | General Polynomial Time Decomposition Algorithms. Nikolas List, Hans Ulrich Simon |
| 2005 | Generalization Error Bounds Using Unlabeled Data. Matti Kääriäinen |
| 2005 | Improved Minimax Bounds on the Test and Training Distortion of Empirically Designed Vector Quantizers. András Antos |
| 2005 | Improved Second-Order Bounds for Prediction with Expert Advice. Nicolò Cesa-Bianchi, Yishay Mansour, Gilles Stoltz |
| 2005 | Learnability of Bipartite Ranking Functions. Shivani Agarwal, Dan Roth |
| 2005 | Learning Convex Combinations of Continuously Parameterized Basic Kernels. Andreas Argyriou, Charles A. Micchelli, Massimiliano Pontil |
| 2005 | Learning Theory, 18th Annual Conference on Learning Theory, COLT 2005, Bertinoro, Italy, June 27-30, 2005, Proceedings Peter Auer, Ron Meir |
| 2005 | Learning a Hidden Hypergraph. Dana Angluin, Jiang Chen |
| 2005 | Leaving the Span. Manfred K. Warmuth, S. V. N. Vishwanathan |
| 2005 | Localized Upper and Lower Bounds for Some Estimation Problems. Tong Zhang |
| 2005 | Loss Bounds for Online Category Ranking. Koby Crammer, Yoram Singer |
| 2005 | Margin-Based Ranking Meets Boosting in the Middle. Cynthia Rudin, Corinna Cortes, Mehryar Mohri, Robert E. Schapire |
| 2005 | Martingale Boosting. Philip M. Long, Rocco A. Servedio |
| 2005 | Mind Change Efficient Learning. Wei Luo, Oliver Schulte |
| 2005 | On Attribute Efficient and Non-adaptive Learning of Parities and DNF Expressions. Vitaly Feldman |
| 2005 | On Spectral Learning of Mixtures of Distributions. Dimitris Achlioptas, Frank McSherry |
| 2005 | On a Syntactic Characterization of Classification with a Mind Change Bound. Eric Martin, Arun Sharma |
| 2005 | On the Consistency of Multiclass Classification Methods. Ambuj Tewari, Peter L. Bartlett |
| 2005 | On the Limitations of Embedding Methods. Shahar Mendelson |
| 2005 | Optimum Follow the Leader Algorithm. Dima Kuzmin, Manfred K. Warmuth |
| 2005 | Permutation Tests for Classification. Polina Golland, Feng Liang, Sayan Mukherjee, Dmitry Panchenko |
| 2005 | Rank, Trace-Norm and Max-Norm. Nathan Srebro, Adi Shraibman |
| 2005 | Ranking and Scoring Using Empirical Risk Minimization. Stéphan Clémençon, Gábor Lugosi, Nicolas Vayatis |
| 2005 | Sensitive Error Correcting Output Codes. John Langford, Alina Beygelzimer |
| 2005 | Separating Models of Learning from Correlated and Uncorrelated Data. Ariel Elbaz, Homin K. Lee, Rocco A. Servedio, Andrew Wan |
| 2005 | Stability and Generalization of Bipartite Ranking Algorithms. Shivani Agarwal, Partha Niyogi |
| 2005 | Teaching Classes with High Teaching Dimension Using Few Examples. Frank J. Balbach |
| 2005 | The Cross Validation Problem. John Langford |
| 2005 | The Spectral Method for General Mixture Models. Ravindran Kannan, Hadi Salmasian, Santosh S. Vempala |
| 2005 | The Value of Agreement, a New Boosting Algorithm. Boaz Leskes |
| 2005 | The Weak Aggregating Algorithm and Weak Mixability. Yuri Kalnishkan, Michael V. Vyugin |
| 2005 | Towards a Theoretical Foundation for Laplacian-Based Manifold Methods. Mikhail Belkin, Partha Niyogi |
| 2005 | Tracking the Best of Many Experts. András György, Tamás Linder, Gábor Lugosi |
| 2005 | Trading in Markovian Price Models. Sham M. Kakade, Michael J. Kearns |
| 2005 | Unlabeled Compression Schemes for Maximum Classes, . Dima Kuzmin, Manfred K. Warmuth |
| 2005 | Variations on U-Shaped Learning. Lorenzo Carlucci, Sanjay Jain, Efim B. Kinber, Frank Stephan |