Daniel Hesslow

17 papers A* 2Journal 10Unranked 4

Year	Rank	Type	Title / Venue / Authors
2024	—	`—`	Limiting factors for the continued scaling of Large Langauge Models : Data Sets, efficient systems for training, model architecture and novel hardware. (Facteurs limitants pour la poursuite de l'escalade des Grands Modèles Linguistiques : Jeux de données, systèmes d'entraînement efficaces, architecture des modèles et matériel novateur). Daniel Hesslow
2023	J	`jnl`	The Falcon Series of Open Language Models. CoRR Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Mérouane Debbah, Étienne Goffinet, Daniel Hesslow, Julien Launay, Quentin Malartic, Daniele Mazzotta, Badreddine Noune, Baptiste Pannier, Guilherme Penedo
2023	A*	`conf`	The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data Only. NeurIPS Guilherme Penedo, Quentin Malartic, Daniel Hesslow, Ruxandra Cojocaru, Hamza Alobeidli, Alessandro Cappelli, Baptiste Pannier, Ebtesam Almazrouei, Julien Launay
2023	J	`jnl`	The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only. CoRR Guilherme Penedo, Quentin Malartic, Daniel Hesslow, Ruxandra Cojocaru, Alessandro Cappelli, Hamza Alobeidli, Baptiste Pannier, Ebtesam Almazrouei, Julien Launay
2022	J	`jnl`	RITA: a Study on Scaling Up Generative Protein Sequence Models. CoRR Daniel Hesslow, Niccoló Zanichelli, Pascal Notin, Iacopo Poli, Debora S. Marks
2022	J	`jnl`	Scaling Laws Beyond Backpropagation. CoRR Matthew J. Filipovich, Alessandro Cappelli, Daniel Hesslow, Julien Launay
2022	J	`jnl`	What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? CoRR Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel
2022	A*	`conf`	What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? ICML Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel
2022	—	`conf`	What Language Model to Train if You Have One Million GPU Hours? EMNLP (Findings) Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
2022	J	`jnl`	What Language Model to Train if You Have One Million GPU Hours? CoRR Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
2021	J	`jnl`	Contrastive Embeddings for Neural Architectures. CoRR Daniel Hesslow, Iacopo Poli
2021	—	`conf`	Is the Number of Trainable Parameters All That Actually Matters? ICBINB@NeurIPS Amélie Chatelain, Amine Djeghri, Daniel Hesslow, Julien Launay
2021	J	`jnl`	Is the Number of Trainable Parameters All That Actually Matters? CoRR Amélie Chatelain, Amine Djeghri, Daniel Hesslow, Julien Launay, Iacopo Poli
2021	—	`conf`	LightOn Optical Processing Unit : Scaling-up AI and HPC with a Non von Neumann co-processor. HCS Charles Brossollet, Alessandro Cappelli, Igor Carron, Charidimos Chaintoutis, Amélie Chatelain, Laurent Daudet, Sylvain Gigan, Daniel Hesslow, Florent Krzakala, Julien Launay, Safa Mokaadi, Fabien Moreau, Kilian Müller, Ruben Ohana, Gustave Pariente, Iacopo Poli, Giuseppe Luca Tommasone
2021	J	`jnl`	LightOn Optical Processing Unit: Scaling-up AI and HPC with a Non von Neumann co-processor. CoRR Charles Brossollet, Alessandro Cappelli, Igor Carron, Charidimos Chaintoutis, Amélie Chatelain, Laurent Daudet, Sylvain Gigan, Daniel Hesslow, Florent Krzakala, Julien Launay, Safa Mokaadi, Fabien Moreau, Kilian Müller, Ruben Ohana, Gustave Pariente, Iacopo Poli, Giuseppe Luca Tommasone
2021	—	`conf`	Photonic co-processors in HPC: Using LightOn OPUs for Randomized Numerical Linear Algebra. HCS Daniel Hesslow, Alessandro Cappelli, Igor Carron, Laurent Daudet, Raphaël Lafargue, Kilian Müller, Ruben Ohana, Gustave Pariente, Iacopo Poli
2021	J	`jnl`	Photonic co-processors in HPC: using LightOn OPUs for Randomized Numerical Linear Algebra. CoRR Daniel Hesslow, Alessandro Cappelli, Igor Carron, Laurent Daudet, Raphaël Lafargue, Kilian Müller, Ruben Ohana, Gustave Pariente, Iacopo Poli