Pete Florence

59 papers A* 13A 1Misc 13Journal 32
YearRankTypeTitle / Venue / Authors
2024 J jnl
ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperation.
CoRR
ALOHA 2 Team, Jorge Aldaco, Travis Armstrong, Robert Baruch, Jeffrey T. Bingham, Sanky Chan, Kenneth Draper, Debidatta Dwibedi, Chelsea Finn, Pete Florence, Spencer Goodrich, Wayne Gramlich, Torr Hage, Alexander Herzog, Jonathan Hoech, Thinh Nguyen, Ian Storz, Baruch Tabanpour, Leila Takayama, Jonathan Tompson, Ayzaan Wahid, Ted Wahrburg, Sichun Xu, Sergey Yaroshenko, Kevin Zakka, Tony Z. Zhao
2024 Misc conf
ALOHA Unleashed: A Simple Recipe for Robot Dexterity.
CoRL
Tony Z. Zhao, Jonathan Tompson, Danny Driess, Pete Florence, Seyed Kamyar Seyed Ghasemipour, Chelsea Finn, Ayzaan Wahid
2024 J jnl
ALOHA Unleashed: A Simple Recipe for Robot Dexterity.
CoRR
Tony Z. Zhao, Jonathan Tompson, Danny Driess, Pete Florence, Kamyar Ghasemipour, Chelsea Finn, Ayzaan Wahid
2024 Misc conf
Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphs.
CoRL
Zhuo Xu, Hao-Tien Lewis Chiang, Zipeng Fu, Mithun George Jacob, Tingnan Zhang, Tsang-Wei Edward Lee, Wenhao Yu, Connor Schenck, David Rendleman, Dhruv Shah, Fei Xia, Jasmine Hsu, Jonathan Hoech, Pete Florence, Sean Kirmani, Sumeet Singh, Vikas Sindhwani, Carolina Parada, Chelsea Finn, Peng Xu, Sergey Levine, Jie Tan
2024 J jnl
Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphs.
CoRR
Hao-Tien Lewis Chiang, Zhuo Xu, Zipeng Fu, Mithun George Jacob, Tingnan Zhang, Tsang-Wei Edward Lee, Wenhao Yu, Connor Schenck, David Rendleman, Dhruv Shah, Fei Xia, Jasmine Hsu, Jonathan Hoech, Pete Florence, Sean Kirmani, Sumeet Singh, Vikas Sindhwani, Carolina Parada, Chelsea Finn, Peng Xu, Sergey Levine, Jie Tan
2024 A* conf
RoboVQA: Multimodal Long-Horizon Reasoning for Robotics.
ICRA
Pierre Sermanet, Tianli Ding, Jeffrey Zhao, Fei Xia, Debidatta Dwibedi, Keerthana Gopalakrishnan, Christine Chan, Gabriel Dulac-Arnold, Sharath Maddineni, Nikhil J. Joshi, Pete Florence, Wei Han, Robert Baruch, Yao Lu, Suvir Mirchandani, Peng Xu, Pannag Sanketi, Karol Hausman, Izhak Shafran, Brian Ichter, Yuan Cao
2024 J jnl
SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities.
CoRR
Boyuan Chen, Zhuo Xu, Sean Kirmani, Brian Ichter, Danny Driess, Pete Florence, Dorsa Sadigh, Leonidas J. Guibas, Fei Xia
2024 A* conf
Video Language Planning.
ICLR
Yilun Du, Sherry Yang, Pete Florence, Fei Xia, Ayzaan Wahid, Brian Ichter, Pierre Sermanet, Tianhe Yu, Pieter Abbeel, Joshua B. Tenenbaum, Leslie Pack Kaelbling, Andy Zeng, Jonathan Tompson
2023 Misc conf
CALAMARI: Contact-Aware and Language conditioned spatial Action MApping for contact-RIch manipulation.
CoRL
Youngsun Wi, Mark Van der Merwe, Pete Florence, Andy Zeng, Nima Fazeli
2023 A* conf
Code as Policies: Language Model Programs for Embodied Control.
ICRA
Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, Andy Zeng
2023 A* conf
Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents.
NeurIPS
Wenlong Huang, Fei Xia, Dhruv Shah, Danny Driess, Andy Zeng, Yao Lu, Pete Florence, Igor Mordatch, Sergey Levine, Karol Hausman, Brian Ichter
2023 J jnl
Grounded Decoding: Guiding Text Generation with Grounded Models for Robot Control.
CoRR
Wenlong Huang, Fei Xia, Dhruv Shah, Danny Driess, Andy Zeng, Yao Lu, Pete Florence, Igor Mordatch, Sergey Levine, Karol Hausman, Brian Ichter
2023 Misc conf
Large Language Models as General Pattern Machines.
CoRL
Suvir Mirchandani, Fei Xia, Pete Florence, Brian Ichter, Danny Driess, Montserrat Gonzalez Arenas, Kanishka Rao, Dorsa Sadigh, Andy Zeng
2023 J jnl
Large Language Models as General Pattern Machines.
CoRR
Suvir Mirchandani, Fei Xia, Pete Florence, Brian Ichter, Danny Driess, Montserrat Gonzalez Arenas, Kanishka Rao, Dorsa Sadigh, Andy Zeng
2023 A* conf
NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis.
CVPR
Allan Zhou, Moo Jin Kim, Lirui Wang, Pete Florence, Chelsea Finn
2023 J jnl
NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis.
CoRR
Allan Zhou, Moo Jin Kim, Lirui Wang, Pete Florence, Chelsea Finn
2023 A* conf
PaLM-E: An Embodied Multimodal Language Model.
ICML
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence
2023 J jnl
PaLM-E: An Embodied Multimodal Language Model.
CoRR
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence
2023 Misc conf
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control.
CoRL
Brianna Zitkovich, Tianhe Yu, Sichun Xu, Peng Xu, Ted Xiao, Fei Xia, Jialin Wu, Paul Wohlhart, Stefan Welker, Ayzaan Wahid, Quan Vuong, Vincent Vanhoucke, Huong T. Tran, Radu Soricut, Anikait Singh, Jaspiar Singh, Pierre Sermanet, Pannag R. Sanketi, Grecia Salazar, Michael S. Ryoo, Krista Reymann, Kanishka Rao, Karl Pertsch, Igor Mordatch, Henryk Michalewski, Yao Lu, Sergey Levine, Lisa Lee, Tsang-Wei Edward Lee, Isabel Leal, Yuheng Kuang, Dmitry Kalashnikov, Ryan Julian, Nikhil J. Joshi, Alex Irpan, Brian Ichter, Jasmine Hsu, Alexander Herzog, Karol Hausman, Keerthana Gopalakrishnan, Chuyuan Fu, Pete Florence, Chelsea Finn, Kumar Avinava Dubey, Danny Driess, Tianli Ding, Krzysztof Marcin Choromanski, Xi Chen, Yevgen Chebotar, Justice Carbajal, Noah Brown, Anthony Brohan, Montserrat Gonzalez Arenas, Kehang Han
2023 J jnl
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control.
CoRR
Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Xi Chen, Krzysztof Choromanski, Tianli Ding, Danny Driess, Avinava Dubey, Chelsea Finn, Pete Florence, Chuyuan Fu, Montse Gonzalez Arenas, Keerthana Gopalakrishnan, Kehang Han, Karol Hausman, Alexander Herzog, Jasmine Hsu, Brian Ichter, Alex Irpan, Nikhil J. Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Isabel Leal, Lisa Lee, Tsang-Wei Edward Lee, Sergey Levine, Yao Lu, Henryk Michalewski, Igor Mordatch, Karl Pertsch, Kanishka Rao, Krista Reymann, Michael S. Ryoo, Grecia Salazar, Pannag Sanketi, Pierre Sermanet, Jaspiar Singh, Anikait Singh, Radu Soricut, Huong T. Tran, Vincent Vanhoucke, Quan Vuong, Ayzaan Wahid, Stefan Welker, Paul Wohlhart, Jialin Wu, Fei Xia, Ted Xiao, Peng Xu, Sichun Xu, Tianhe Yu, Brianna Zitkovich
2023 J jnl
RoboPianist: A Benchmark for High-Dimensional Robot Control.
CoRR
Kevin Zakka, Laura Smith, Nimrod Gileadi, Taylor A. Howell, Xue Bin Peng, Sumeet Singh, Yuval Tassa, Pete Florence, Andy Zeng, Pieter Abbeel
2023 Misc conf
RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learning.
CoRL
Kevin Zakka, Philipp Wu, Laura Smith, Nimrod Gileadi, Taylor Howell, Xue Bin Peng, Sumeet Singh, Yuval Tassa, Pete Florence, Andy Zeng, Pieter Abbeel
2023 J jnl
RoboVQA: Multimodal Long-Horizon Reasoning for Robotics.
CoRR
Pierre Sermanet, Tianli Ding, Jeffrey Zhao, Fei Xia, Debidatta Dwibedi, Keerthana Gopalakrishnan, Christine Chan, Gabriel Dulac-Arnold, Sharath Maddineni, Nikhil J. Joshi, Pete Florence, Wei Han, Robert Baruch, Yao Lu, Suvir Mirchandani, Peng Xu, Pannag Sanketi, Karol Hausman, Izhak Shafran, Brian Ichter, Yuan Cao
2023 Misc conf
Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition.
CoRL
Huy Ha, Pete Florence, Shuran Song
2023 J jnl
Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition.
CoRR
Huy Ha, Pete Florence, Shuran Song
2023 J jnl
Single-Level Differentiable Contact Simulation.
IEEE Robotics Autom. Lett.
Simon Le Cleac'h, Mac Schwager, Zachary Manchester, Vikas Sindhwani, Pete Florence, Sumeet Singh
2023 A* conf
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language.
ICLR
Andy Zeng, Maria Attarian, Brian Ichter, Krzysztof Marcin Choromanski, Adrian Wong, Stefan Welker, Federico Tombari, Aveek Purohit, Michael S. Ryoo, Vikas Sindhwani, Johnny Lee, Vincent Vanhoucke, Pete Florence
2023 J jnl
Towards Generalist Biomedical AI.
CoRR
Tao Tu, Shekoofeh Azizi, Danny Driess, Mike Schaekermann, Mohamed Amin, Pi-Chuan Chang, Andrew Carroll, Chuck Lau, Ryutaro Tanno, Ira Ktena, Basil Mustafa, Aakanksha Chowdhery, Yun Liu, Simon Kornblith, David J. Fleet, Philip Andrew Mansfield, Sushant Prakash, Renee Wong, Sunny Virmani, Christopher Semturs, S. Sara Mahdavi, Bradley Green, Ewa Dominowska, Blaise Agüera y Arcas, Joelle K. Barral, Dale R. Webster, Gregory S. Corrado, Yossi Matias, Karan Singhal, Pete Florence, Alan Karthikesalingam, Vivek Natarajan
2023 J jnl
Video Language Planning.
CoRR
Yilun Du, Mengjiao Yang, Pete Florence, Fei Xia, Ayzaan Wahid, Brian Ichter, Pierre Sermanet, Tianhe Yu, Pieter Abbeel, Joshua B. Tenenbaum, Leslie Pack Kaelbling, Andy Zeng, Jonathan Tompson
2023 A* conf
Visuomotor Control in Multi-Object Scenes Using Object-Aware Representations.
ICRA
Negin Heravi, Ayzaan Wahid, Corey Lynch, Pete Florence, Travis Armstrong, Jonathan Tompson, Pierre Sermanet, Jeannette Bohg, Debidatta Dwibedi
2022 J jnl
Code as Policies: Language Model Programs for Embodied Control.
CoRR
Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, Andy Zeng
2022 A* conf
Implicit Kinematic Policies: Unifying Joint and Cartesian Action Spaces in End-to-End Robot Learning.
ICRA
Aditya Ganapathi, Pete Florence, Jake Varley, Kaylee Burns, Ken Goldberg, Andy Zeng
2022 J jnl
Implicit Kinematic Policies: Unifying Joint and Cartesian Action Spaces in End-to-End Robot Learning.
CoRR
Aditya Ganapathi, Pete Florence, Jake Varley, Kaylee Burns, Ken Goldberg, Andy Zeng
2022 Misc conf
Inner Monologue: Embodied Reasoning through Planning with Language Models.
CoRL
Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, Pierre Sermanet, Tomas Jackson, Noah Brown, Linda Luu, Sergey Levine, Karol Hausman, Brian Ichter
2022 J jnl
Inner Monologue: Embodied Reasoning through Planning with Language Models.
CoRR
Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, Pierre Sermanet, Noah Brown, Tomas Jackson, Linda Luu, Sergey Levine, Karol Hausman, Brian Ichter
2022 J jnl
Interactive Language: Talking to Robots in Real Time.
CoRR
Corey Lynch, Ayzaan Wahid, Jonathan Tompson, Tianli Ding, James Betker, Robert Baruch, Travis Armstrong, Pete Florence
2022 Misc conf
MIRA: Mental Imagery for Robotic Affordances.
CoRL
Yen-Chen Lin, Pete Florence, Andy Zeng, Jonathan T. Barron, Yilun Du, Wei-Chiu Ma, Anthony Simeonov, Alberto Rodriguez Garcia, Phillip Isola
2022 J jnl
MIRA: Mental Imagery for Robotic Affordances.
CoRR
Yen-Chen Lin, Pete Florence, Andy Zeng, Jonathan T. Barron, Yilun Du, Wei-Chiu Ma, Anthony Simeonov, Alberto Rodriguez Garcia, Phillip Isola
2022 A* conf
NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields.
ICRA
Yen-Chen Lin, Pete Florence, Jonathan T. Barron, Tsung-Yi Lin, Alberto Rodriguez, Phillip Isola
2022 J jnl
NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields.
CoRR
Yen-Chen Lin, Pete Florence, Jonathan T. Barron, Tsung-Yi Lin, Alberto Rodriguez Garcia, Phillip Isola
2022 A* conf
Reinforcement Learning with Neural Radiance Fields.
NeurIPS
Danny Driess, Ingmar Schubert, Pete Florence, Yunzhu Li, Marc Toussaint
2022 J jnl
Single-Level Differentiable Contact Simulation.
CoRR
Simon Le Cleac'h, Mac Schwager, Zachary Manchester, Vikas Sindhwani, Pete Florence, Sumeet Singh
2022 J jnl
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language.
CoRR
Andy Zeng, Adrian Wong, Stefan Welker, Krzysztof Choromanski, Federico Tombari, Aveek Purohit, Michael S. Ryoo, Vikas Sindhwani, Johnny Lee, Vincent Vanhoucke, Pete Florence
2022 Misc conf
VIRDO++: Real-World, Visuo-tactile Dynamics and Perception of Deformable Objects.
CoRL
Youngsun Wi, Andy Zeng, Pete Florence, Nima Fazeli
2022 J jnl
VIRDO++: Real-World, Visuo-tactile Dynamics and Perception of Deformable Objects.
CoRR
Youngsun Wi, Andy Zeng, Pete Florence, Nima Fazeli
2022 A* conf
VIRDO: Visio-tactile Implicit Representations of Deformable Objects.
ICRA
Youngsun Wi, Pete Florence, Andy Zeng, Nima Fazeli
2022 J jnl
VIRDO: Visio-tactile Implicit Representations of Deformable Objects.
CoRR
Youngsun Wi, Pete Florence, Andy Zeng, Nima Fazeli
2022 J jnl
Visuomotor Control in Multi-Object Scenes Using Object-Aware Representations.
CoRR
Negin Heravi, Ayzaan Wahid, Corey Lynch, Pete Florence, Travis Armstrong, Jonathan Tompson, Pierre Sermanet, Jeannette Bohg, Debidatta Dwibedi
2021 Misc conf
Implicit Behavioral Cloning.
CoRL
Pete Florence, Corey Lynch, Andy Zeng, Oscar A. Ramirez, Ayzaan Wahid, Laura Downs, Adrian Wong, Johnny Lee, Igor Mordatch, Jonathan Tompson
2021 J jnl
Implicit Behavioral Cloning.
CoRR
Pete Florence, Corey Lynch, Andy Zeng, Oscar Ramirez, Ayzaan Wahid, Laura Downs, Adrian Wong, Johnny Lee, Igor Mordatch, Jonathan Tompson
2021 A* conf
Learning to Rearrange Deformable Cables, Fabrics, and Bags with Goal-Conditioned Transporter Networks.
ICRA
Daniel Seita, Pete Florence, Jonathan Tompson, Erwin Coumans, Vikas Sindhwani, Ken Goldberg, Andy Zeng
2021 J jnl
Trajectory Optimization with Optimization-Based Dynamics.
CoRR
Taylor A. Howell, Simon Le Cleac'h, Sumeet Singh, Pete Florence, Zachary Manchester, Vikas Sindhwani
2021 Misc conf
XIRL: Cross-embodiment Inverse Reinforcement Learning.
CoRL
Kevin Zakka, Andy Zeng, Pete Florence, Jonathan Tompson, Jeannette Bohg, Debidatta Dwibedi
2021 J jnl
XIRL: Cross-embodiment Inverse Reinforcement Learning.
CoRR
Kevin Zakka, Andy Zeng, Pete Florence, Jonathan Tompson, Jeannette Bohg, Debidatta Dwibedi
2021 A conf
iNeRF: Inverting Neural Radiance Fields for Pose Estimation.
IROS
Yen-Chen Lin, Pete Florence, Jonathan T. Barron, Alberto Rodriguez, Phillip Isola, Tsung-Yi Lin
2020 J jnl
Learning to Rearrange Deformable Cables, Fabrics, and Bags with Goal-Conditioned Transporter Networks.
CoRR
Daniel Seita, Pete Florence, Jonathan Tompson, Erwin Coumans, Vikas Sindhwani, Ken Goldberg, Andy Zeng
2020 Misc conf
Transporter Networks: Rearranging the Visual World for Robotic Manipulation.
CoRL
Andy Zeng, Pete Florence, Jonathan Tompson, Stefan Welker, Jonathan Chien, Maria Attarian, Travis Armstrong, Ivan Krasin, Dan Duong, Vikas Sindhwani, Johnny Lee
2020 J jnl
Transporter Networks: Rearranging the Visual World for Robotic Manipulation.
CoRR
Andy Zeng, Pete Florence, Jonathan Tompson, Stefan Welker, Jonathan Chien, Maria Attarian, Travis Armstrong, Ivan Krasin, Dan Duong, Vikas Sindhwani, Johnny Lee
2020 J jnl
iNeRF: Inverting Neural Radiance Fields for Pose Estimation.
CoRR
Yen-Chen Lin, Pete Florence, Jonathan T. Barron, Alberto Rodriguez Garcia, Phillip Isola, Tsung-Yi Lin