Updates
2022 July 5th: Post-Workshop Update 2. Uploaded the videos of the debate and panel. See Videos
2022 June 28th: Post-Workshop Update 1. We’d love to send a thanks out to all debaters, authors, and participants that helped make this workshop so great! Thanks folks, you’re awesome! ❤️ Also we’ve uploaded the accepted papers in their preliminary version, see Accepted Papers.
2022 June 27th: Accepted papers will be posted on this page tonight. Added Greg Chirikjian in the 12:30-1pm slot as invited speaker.
2022 June 25th: Added Schedule and Ken Goldberg as invited speaker & panelist.
2022 June 20th: Added Hongzhuo as additional organizer.
2022 May 3rd: Added the CMT link and submission instructions. Submissions are now open. Also we’re excited to add Dorsa Sadigh as in-person debater to the roster.
2022 April: Workshop got accepted 🎉, currently preparing CMT submission system and announcement.
After 2 years of remote conferences, we’re happy to announce that R:SS this year and by extension
this workshop will allow in-person attendance 🎉🎉🎉.
Videos [Top]
Debate: Is Sim2Real Solved? |
Panel Discussion: What matters in Sim2Real? |
Overview [Top]
Physical simulation is an important tool for robotics. While simulation has been well-established for robotics education and integrated robot software testing for a long time, only recently the robotics community has made significant progress in transferring capabilities learned in simulation to reality, a concept termed Sim2Real transfer.
Sim2Real refers to a concept of transferring robot skills acquired in simulation to the real robotic system. Sim2Real draws its appeal from the fact that it is cheaper, safer and more informative to perform experiments in simulation than in the real world – yet, Sim2Real faces significant challenges.
In this workshop we invite well-known researchers to debate the state of the art and the impact of Sim2Real on robotics. In this workshop we invite well-known researchers to debate the state of the art and the impact of Sim2Real on robotics. The proposed workshop is the third edition of a workshop that happened at R:SS 2019 and at R:SS 2020. In this year’s edition, we aim to review the actual progress in Sim2Real more critically by changing the workshop format: inspired by the ICRA 2019 robotic debates workshop, for this workshop we will invite top-researchers to participate in debates focussed on controversial key topics with a few spotlight presentations.
Invited Debaters & Speakers [Top]
Daniela Rus (MIT) |
David Hsu (National University of Singapore) |
Ken Goldberg (UC Berkeley) |
Gregory Chirikjian (National University of Singapore) |
Fabio Ramos (Nvidia & University of Sydney) |
Stefanie Tellex (Brown University) |
Animesh Garg (University of Toronto) |
Dorsa Sadigh (Stanford University) |
Viktor Makoviychuk (Nvidia) |
Call for Contributions [Top]
Participants are invited to submit extended abstracts (maximum 2 pages in length, excluding references). We encourage both position papers as well general sim2real submissions.
Accepted abstracts will receive a poster presentation slot and selected submissions will additionally be allowed to give a spotlight presentation for 5min each, ahead of the debate that’s most in line with the subject.
Submissions must be in PDF format following the IEEE style. Submissions must include a short abstract. The extended abstract should go in the main section of the template and the short abstract in the abstract section.
Submission website: https://cmt3.research.microsoft.com/Sim2Real2022/Submission/Index
Important dates [Top]
- Paper Submission Deadline: May 31st, 2022
- Acceptance Notification: June 7th, 2022
- Workshop: June 27th, 2022 (full day)
- Main Conference: June 27th - July 1st, 2022
Accepted Papers [Top]
-
“A Framework for Curriculum Schema Transfer from Low-Fidelity to High-Fidelity Environments”
Yash Shukla, Jivko Sinapov
[PDF] -
“A Recurrent Differentiable Physics Engine for Tensegrity Robots”
Kun Wang, Mridul Aanjaneya, Kostas Bekris
[PDF] -
“CaTGrasp: Learning Category-Level Task-Relevant Grasping from Simulation”
Bowen Wen, Wenzhao Lian; Kostas Bekris; Stefan Schaal
[PDF] -
“Closing the Sim-to-Real Gap for Ultra-Low-Cost, Resource-Constrained, Quadruped Robot Platforms”
Jason Jabbour; Sabrina Neuman; Mark Mazumder; Colby Banbury; Shvetank Prakash; Brian Plancher; Vijay Janapa Reddi
[PDF] -
“Learning Agile, Vision-based Drone Flight: from Simulation to Reality”
Davide Scaramuzza, Elia Kaufmann
(Sorry, PDF not available. Please reach out to Davide) -
“The gap in functional electrical stimulation simulation”
Aran Sena; Hossein Kavianirad; Satoshi Endo; Etienne Burdet; Sandra Hirche
[PDF] -
“Toward Real-World Implementation of Deep Reinforcement Learning for Vision-Based Autonomous Drone Navigation with Mission”
Mozhgan Navardi; Prakhar Dixit; Tejaswini Manjunath; Nicholas R Waytowich; Tinoosh Mohseninn; Tim Oates
[PDF] -
“Towards Sim2Real for Shipwreck Detection in Side Scan Sonar Imagery”
Advaith V Sethuraman; Katherine A Skinner
[PDF]
Schedule [Top]
Timeslot | Event | Speakers |
---|---|---|
09:00 - 09:10 | Welcome | |
09:10 - 10:00 | Papers Session 1 | "Learning Agile, Vision-based Drone Flight: from Simulation to Reality", "Toward Real-World Implementation of Deep Reinforcement Learning for Vision-Based Autonomous Drone Navigation with Mission", "A Recurrent Differentiable Physics Engine for Tensegrity Robots", "Closing the Sim-to-Real Gap for Ultra-Low-Cost, Resource-Constrained, Quadruped Robot Platforms" |
10:00 - 10:30 | Coffee Break | |
10:30 - 11:30 | Debate 1 - "Sim2Real is Solved" | Dorsa Sadigh & David Hsu vs. Fabio Ramos & Animesh Garg |
11:30 - 12:30 | Papers Session 2 | "The gap in functional electrical stimulation simulation", "Towards Sim2Real for Shipwreck Detection in Side Scan Sonar Imagery", "CaTGrasp: Learning Category-Level Task-Relevant Grasping from Simulation", "A Framework for Curriculum Schema Transfer from Low-Fidelity to High-Fidelity Environments" |
12:30 - 13:00 | Invited Talk | Updated: Gregory Chirikjian |
13:00 - 14:00 | Lunch break | |
14:00 - 14:20 | Invited Talk | Ken Goldberg (Real2Sim2Real) |
14:20 - 15:30 | Panel Discussion | Viktor Makoviychuk, Stefanie Tellex, Dorsa Sadigh, Ken Goldberg |
15:30 - 15:45 | Invited Talk | Daniela Rus (Vista Simulator) |
15:45 - 15:50 | Closing | |
15:50 - 16:15 | Coffee Break & Virtual Poster Session |
Organizers [Top]
Florian Golemo is a postdoctoral fellow at Mila and ServiceNow, working with Liam Paull and Chris Pal on Sim2Real and 3D perception problems. He received his PhD from INRIA Bordeaux under supervision of Pierre-Yves Oudeyer. |
Melissa Mozifian is a PhD Candidate at the School of Computer Science at McGill University. Her research focuses on deep reinforcement learning and transfer for control of robot manipulation tasks. |
Hongzhuo Liang is a PhD Candidate at the University of Hamburg, Germany. He has completed his PhD defense in May 2022 and will work as a postdoc at the University of Hamburg. His research focuses on robotic grasping and multimodal deep reinforcement learning for different robotic manipulation skills. |
Ankur Handa is a senior research scientist at NVIDIA robotics lab run by Dieter Fox. Prior to that he was a research scientist at OpenAI. He received his Ph.D. with Dr. Andrew Davison and spent two years at University of Cambridge in Prof. Roberto Cipolla’s lab as a post-doctoral researcher. |
Kostas Bekris is an Associate Professor at the Computer Science department of Rutgers University and an Amazon Scholar at the Amazon Robotics AI team headed by Siddhartha Srinivasa. He received his PhD with Lydia Kavraki at Rice University. |