Daniel Simig

16 papers A* 3Journal 10Unranked 3
YearRankTypeTitle / Venue / Authors
2023 A* conf
D4: Improving LLM Pretraining via Document De-Duplication and Diversification.
NeurIPS
Kushal Tirumala, Daniel Simig, Armen Aghajanyan, Ari Morcos
2023 J jnl
D4: Improving LLM Pretraining via Document De-Duplication and Diversification.
CoRR
Kushal Tirumala, Daniel Simig, Armen Aghajanyan, Ari S. Morcos
2023 J jnl
Evaluating end-to-end entity linking on domain-specific knowledge bases: Learning about ancient technologies from museum collections.
CoRR
Sebastian Cadavid-Sanchez, Khalil Kacem, Rafael Aparecido Martins Frade, Johannes Boehm, Thomas Chaney, Danial Lashkari, Daniel Simig
2023 A* conf
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers.
NeurIPS
Lili Yu, Daniel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis
2023 J jnl
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers.
CoRR
Lili Yu, Daniel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis
2023 J jnl
SemDeDup: Data-efficient learning at web-scale through semantic deduplication.
CoRR
Amro Abbas, Kushal Tirumala, Daniel Simig, Surya Ganguli, Ari S. Morcos
2023 — conf
Understanding In-Context Learning via Supportive Pretraining Data.
ACL (1)
Xiaochuang Han, Daniel Simig, Todor Mihaylov, Yulia Tsvetkov, Asli Celikyilmaz, Tianlu Wang
2023 J jnl
Understanding In-Context Learning via Supportive Pretraining Data.
CoRR
Xiaochuang Han, Daniel Simig, Todor Mihaylov, Yulia Tsvetkov, Asli Celikyilmaz, Tianlu Wang
2022 A* conf
Few-shot Learning with Multilingual Generative Language Models.
EMNLP
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li
2022 J jnl
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization.
CoRR
Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, Todor Mihaylov, Daniel Simig, Ping Yu, Kurt Shuster, Tianlu Wang, Qing Liu, Punit Singh Koura, Xian Li, Brian O'Horo, Gabriel Pereyra, Jeff Wang, Christopher Dewan, Asli Celikyilmaz, Luke Zettlemoyer, Ves Stoyanov
2022 J jnl
OPT: Open Pre-trained Transformer Language Models.
CoRR
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona T. Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer
2022 — conf
Open Vocabulary Extreme Classification Using Generative Models.
ACL (Findings)
Daniel Simig, Fabio Petroni, Pouya Yanki, Kashyap Popat, Christina Du, Sebastian Riedel, Majid Yazdani
2022 J jnl
Open Vocabulary Extreme Classification Using Generative Models.
CoRR
Daniel Simig, Fabio Petroni, Pouya Yanki, Kashyap Popat, Christina Du, Sebastian Riedel, Majid Yazdani
2022 — conf
Text Characterization Toolkit (TCT).
AACL/IJCNLP (System Demonstrations)
Daniel Simig, Tianlu Wang, Verna Dankers, Peter Henderson, Khuyagbaatar Batsuren, Dieuwke Hupkes, Mona T. Diab
2022 J jnl
Text Characterization Toolkit.
CoRR
Daniel Simig, Tianlu Wang, Verna Dankers, Peter Henderson, Khuyagbaatar Batsuren, Dieuwke Hupkes, Mona T. Diab
2021 J jnl
Few-shot Learning with Multilingual Language Models.
CoRR
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li