Oleksii Kuchaiev

51 papers A* 4A 4Misc 3Journal 31Unranked 9
YearRankTypeTitle / Venue / Authors
2026 J jnl
PivotRL: High Accuracy Agentic Post-Training at Low Compute Cost.
CoRR
Junkeun Yi, Damon Mosk-Aoyama, Baihe Huang, Ritu Gala, Charles Wang, Sugam Dipak Devare, Khushi Bhardwaj, Abhibha Gupta, Oleksii Kuchaiev, Jiantao Jiao, Jian Zhang, Venkat Srinivasan
2025 J jnl
Adversarial Training of Reward Models.
CoRR
Alexander Bukharin, Haifeng Qian, Shengyang Sun, Adithya Renduchintala, Soumye Singhal, Zhilin Wang, Oleksii Kuchaiev, Olivier Delalleau, Tuo Zhao
2025 J jnl
Dedicated Feedback and Edit Models Empower Inference-Time Scaling for Open-Ended General-Domain Tasks.
CoRR
Zhilin Wang, Jiaqi Zeng, Olivier Delalleau, Daniel Egert, Ellie Evans, Hoo-Chang Shin, Felipe Soares, Yi Dong, Oleksii Kuchaiev
2025 A* conf
HelpSteer2-Preference: Complementing Ratings with Preferences.
ICLR
Zhilin Wang, Alexander Bukharin, Olivier Delalleau, Daniel Egert, Gerald Shen, Jiaqi Zeng, Oleksii Kuchaiev, Yi Dong
2025 J jnl
HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages.
CoRR
Zhilin Wang, Jiaqi Zeng, Olivier Delalleau, Hoo-Chang Shin, Felipe Soares, Alexander Bukharin, Ellie Evans, Yi Dong, Oleksii Kuchaiev
2025 — conf
HelpSteer3: Human-Annotated Feedback and Edit Data to Empower Inference-Time Scaling in Open-Ended General-Domain Tasks.
ACL (1)
Zhilin Wang, Jiaqi Zeng, Olivier Delalleau, Daniel Egert, Ellie Evans, Hoo-Chang Shin, Felipe Soares, Yi Dong, Oleksii Kuchaiev
2025 J jnl
RLBFF: Binary Flexible Feedback to bridge between Human Feedback & Verifiable Rewards.
CoRR
Zhilin Wang, Jiaqi Zeng, Olivier Delalleau, Ellie Evans, Daniel Egert, Hoo-Chang Shin, Felipe Soares, Yi Dong, Oleksii Kuchaiev
2025 J jnl
Reward-aware Preference Optimization: A Unified Mathematical Framework for Model Alignment.
CoRR
Shengyang Sun, Yian Zhang, Alexander Bukharin, David Mosallanezhad, Jiaqi Zeng, Soumye Singhal, Gerald Shen, Adithya Renduchintala, Tugrul Konuk, Yi Dong, Zhilin Wang, Dmitry Chichkov, Olivier Delalleau, Oleksii Kuchaiev
2025 J jnl
Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training.
CoRR
Mingjie Liu, Shizhe Diao, Jian Hu, Ximing Lu, Xin Dong, Hao Zhang, Alexander Bukharin, Shaokun Zhang, Jiaqi Zeng, Makesh Narsimhan Sreedhar, Gerald Shen, David Mosallanezhad, Di Zhang, Jonas Yang, June Yang, Oleksii Kuchaiev, Guilin Liu, Zhiding Yu, Pavlo Molchanov, Yejin Choi, Jan Kautz, Yi Dong
2025 J jnl
Think Twice: Branch-and-Rethink Reasoning Reward Model.
CoRR
Yizhu Jiao, Jiaqi Zeng, Julien Veron Vialard, Oleksii Kuchaiev, Jiawei Han, Olivier Delalleau
2024 A* conf
GPT vs RETRO: Exploring the Intersection of Retrieval and Parameter-Efficient Fine-Tuning.
EMNLP
Aleksander Ficek, Jiaqi Zeng, Oleksii Kuchaiev
2024 J jnl
GPT vs RETRO: Exploring the Intersection of Retrieval and Parameter-Efficient Fine-Tuning.
CoRR
Aleksander Ficek, Jiaqi Zeng, Oleksii Kuchaiev
2024 A* conf
HelpSteer 2: Open-source dataset for training top-performing reward models.
NeurIPS
Zhilin Wang, Yi Dong, Olivier Delalleau, Jiaqi Zeng, Gerald Shen, Daniel Egert, Jimmy Zhang, Makesh Narsimhan Sreedhar, Oleksii Kuchaiev
2024 J jnl
HelpSteer2-Preference: Complementing Ratings with Preferences.
CoRR
Zhilin Wang, Alexander Bukharin, Olivier Delalleau, Daniel Egert, Gerald Shen, Jiaqi Zeng, Oleksii Kuchaiev, Yi Dong
2024 J jnl
HelpSteer2: Open-source dataset for training top-performing reward models.
CoRR
Zhilin Wang, Yi Dong, Olivier Delalleau, Jiaqi Zeng, Gerald Shen, Daniel Egert, Jimmy J. Zhang, Makesh Narsimhan Sreedhar, Oleksii Kuchaiev
2024 — conf
HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM.
NAACL-HLT
Zhilin Wang, Yi Dong, Jiaqi Zeng, Virginia Adams, Makesh Narsimhan Sreedhar, Daniel Egert, Olivier Delalleau, Jane Polak Scowcroft, Neel Kant, Aidan Swope, Oleksii Kuchaiev
2024 J jnl
NeMo-Aligner: Scalable Toolkit for Efficient Model Alignment.
CoRR
Gerald Shen, Zhilin Wang, Olivier Delalleau, Jiaqi Zeng, Yi Dong, Daniel Egert, Shengyang Sun, Jimmy J. Zhang, Sahil Jain, Ali Taghibakhshi, Markel Sanz Ausin, Ashwath Aithal, Oleksii Kuchaiev
2024 J jnl
Nemotron-4 15B Technical Report.
CoRR
Jupinder Parmar, Shrimai Prabhumoye, Joseph Jennings, Mostofa Patwary, Sandeep Subramanian, Dan Su, Chen Zhu, Deepak Narayanan, Aastha Jhunjhunwala, Ayush Dattagupta, Vibhu Jawa, Jiwei Liu, Ameya Mahabaleshwarkar, Osvald Nitski, Annika Brundyn, James Maki, Miguel Martinez, Jiaxuan You, John Kamalu, Patrick LeGresley, Denys Fridman, Jared Casper, Ashwath Aithal, Oleksii Kuchaiev, Mohammad Shoeybi, Jonathan M. Cohen, Bryan Catanzaro
2024 — conf
Tied-LoRA: Enhancing parameter efficiency of LoRA with Weight Tying.
NAACL-HLT
Adithya Renduchintala, Tugrul Konuk, Oleksii Kuchaiev
2023 J jnl
HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM.
CoRR
Zhilin Wang, Yi Dong, Jiaqi Zeng, Virginia Adams, Makesh Narsimhan Sreedhar, Daniel Egert, Olivier Delalleau, Jane Polak Scowcroft, Neel Kant, Aidan Swope, Oleksii Kuchaiev
2023 — conf
Leveraging Synthetic Targets for Machine Translation.
ACL (Findings)
Sarthak Mittal, Oleksii Hrinchuk, Oleksii Kuchaiev
2023 J jnl
Leveraging Synthetic Targets for Machine Translation.
CoRR
Sarthak Mittal, Oleksii Hrinchuk, Oleksii Kuchaiev
2023 A* conf
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study.
EMNLP
Boxin Wang, Wei Ping, Peng Xu, Lawrence McAfee, Zihan Liu, Mohammad Shoeybi, Yi Dong, Oleksii Kuchaiev, Bo Li, Chaowei Xiao, Anima Anandkumar, Bryan Catanzaro
2023 J jnl
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study.
CoRR
Boxin Wang, Wei Ping, Peng Xu, Lawrence McAfee, Zihan Liu, Mohammad Shoeybi, Yi Dong, Oleksii Kuchaiev, Bo Li, Chaowei Xiao, Anima Anandkumar, Bryan Catanzaro
2023 — conf
SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF.
EMNLP (Findings)
Yi Dong, Zhilin Wang, Makesh Narsimhan Sreedhar, Xianchao Wu, Oleksii Kuchaiev
2023 J jnl
SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF.
CoRR
Yi Dong, Zhilin Wang, Makesh Narsimhan Sreedhar, Xianchao Wu, Oleksii Kuchaiev
2023 J jnl
Tied-Lora: Enhacing parameter efficiency of LoRA with weight tying.
CoRR
Adithya Renduchintala, Tugrul Konuk, Oleksii Kuchaiev
2022 J jnl
Finding the Right Recipe for Low Resource Domain Adaptation in Neural Machine Translation.
CoRR
Virginia Adams, Sandeep Subramanian, Mike Chrzanowski, Oleksii Hrinchuk, Oleksii Kuchaiev
2022 — conf
NVIDIA NeMo Offline Speech Translation Systems for IWSLT 2022.
IWSLT@ACL
Oleksii Hrinchuk, Vahid Noroozi, Ashwinkumar Ganesan, Sarah Campbell, Sandeep Subramanian, Somshubra Majumdar, Oleksii Kuchaiev
2021 A conf
Cross-Language Transfer Learning and Domain Adaptation for End-to-End Automatic Speech Recognition.
ICME
Jian Luo, Jianzong Wang, Ning Cheng, Edward Xiao, Jing Xiao, Georg Kucsko, Patrick K. O'Neill, Jagadeesh Balam, Slyne Deng, Adriana Flores, Boris Ginsburg, Jocelyn Huang, Oleksii Kuchaiev, Vitaly Lavrukhin, Jason Li
2021 J jnl
NVIDIA NeMo Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21.
CoRR
Sandeep Subramanian, Oleksii Hrinchuk, Virginia Adams, Oleksii Kuchaiev
2021 — conf
NVIDIA NeMo's Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21.
WMT@EMNLP
Sandeep Subramanian, Oleksii Hrinchuk, Virginia Adams, Oleksii Kuchaiev
2021 A conf
SPGISpeech: 5, 000 Hours of Transcribed Financial Audio for Fully Formatted End-to-End Speech Recognition.
Interspeech
Patrick K. O'Neill, Vitaly Lavrukhin, Somshubra Majumdar, Vahid Noroozi, Yuekai Zhang, Oleksii Kuchaiev, Jagadeesh Balam, Yuliya Dovzhenko, Keenan Freyberg, Michael D. Shulman, Boris Ginsburg, Shinji Watanabe, Georg Kucsko
2021 J jnl
SPGISpeech: 5, 000 hours of transcribed financial audio for fully formatted end-to-end speech recognition.
CoRR
Patrick K. O'Neill, Vitaly Lavrukhin, Somshubra Majumdar, Vahid Noroozi, Yuekai Zhang, Oleksii Kuchaiev, Jagadeesh Balam, Yuliya Dovzhenko, Keenan Freyberg, Michael D. Shulman, Boris Ginsburg, Shinji Watanabe, Georg Kucsko
2020 Misc conf
Quartznet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions.
ICASSP
Samuel Kriman, Stanislav Beliaev, Boris Ginsburg, Jocelyn Huang, Oleksii Kuchaiev, Vitaly Lavrukhin, Ryan Leary, Jason Li, Yang Zhang
2019 A conf
Jasper: An End-to-End Convolutional Neural Acoustic Model.
INTERSPEECH
Jason Li, Vitaly Lavrukhin, Boris Ginsburg, Ryan Leary, Oleksii Kuchaiev, Jonathan M. Cohen, Huyen Nguyen, Ravi Teja Gadde
2019 J jnl
Jasper: An End-to-End Convolutional Neural Acoustic Model.
CoRR
Jason Li, Vitaly Lavrukhin, Boris Ginsburg, Ryan Leary, Oleksii Kuchaiev, Jonathan M. Cohen, Huyen Nguyen, Ravi Teja Gadde
2019 J jnl
NeMo: a toolkit for building AI applications using Neural Modules.
CoRR
Oleksii Kuchaiev, Jason Li, Huyen Nguyen, Oleksii Hrinchuk, Ryan Leary, Boris Ginsburg, Samuel Kriman, Stanislav Beliaev, Vitaly Lavrukhin, Jack Cook, Patrice Castonguay, Mariya Popova, Jocelyn Huang, Jonathan M. Cohen
2019 J jnl
Stochastic Gradient Methods with Layer-wise Adaptive Moments for Training of Deep Networks.
CoRR
Boris Ginsburg, Patrice Castonguay, Oleksii Hrinchuk, Oleksii Kuchaiev, Vitaly Lavrukhin, Ryan Leary, Jason Li, Huyen Nguyen, Jonathan M. Cohen
2018 — conf
Mixed Precision Training.
ICLR (Poster)
Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory F. Diamos, Erich Elsen, David García, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, Hao Wu
2018 J jnl
OpenSeq2Seq: extensible toolkit for distributed and mixed precision training of sequence-to-sequence models.
CoRR
Oleksii Kuchaiev, Boris Ginsburg, Igor Gitman, Vitaly Lavrukhin, Carl Case, Paulius Micikevicius
2017 — conf
Factorization tricks for LSTM networks.
ICLR (Workshop)
Oleksii Kuchaiev, Boris Ginsburg
2017 J jnl
Factorization tricks for LSTM networks.
CoRR
Oleksii Kuchaiev, Boris Ginsburg
2017 J jnl
Mixed Precision Training.
CoRR
Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory F. Diamos, Erich Elsen, David García, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, Hao Wu
2017 J jnl
Training Deep AutoEncoders for Collaborative Filtering.
CoRR
Oleksii Kuchaiev, Boris Ginsburg
2014 A conf
An introduction to computational networks and the computational network toolkit (invited talk).
INTERSPEECH
Dong Yu, Adam Eversole, Michael L. Seltzer, Kaisheng Yao, Brian Guenter, Oleksii Kuchaiev, Frank Seide, Huaming Wang, Jasha Droppo, Zhiheng Huang, Geoffrey Zweig, Christopher J. Rossbach, Jon Currey
2011 J jnl
GraphCruch 2: Software tool for network modeling, alignment and clustering.
BMC Bioinform.
Oleksii Kuchaiev, Aleksandar Stevanovic, Wayne B. Hayes, Natasa Przulj
2011 J jnl
Integrative network alignment reveals large regions of global network similarity in yeast and human.
Bioinform.
Oleksii Kuchaiev, Natasa Przulj
2010 Misc conf
Geometric Evolutionary Dynamics of Protein Interaction Networks.
Pacific Symposium on Biocomputing
Natasa Przulj, Oleksii Kuchaiev, Aleksandar Stevanovic, Wayne B. Hayes
2009 J jnl
Geometric De-noising of Protein-Protein Interaction Networks.
PLoS Comput. Biol.
Oleksii Kuchaiev, Marija Rasajski, Desmond J. Higham, Natasa Przulj
2009 Misc conf
Learning the Structure of Protein-Protein Interaction Networks.
Pacific Symposium on Biocomputing
Oleksii Kuchaiev, Natasa Przulj