[data science] CVPR 2022: Robot Learning Tutorial (Vision, Text)

Undiscussed Horrific Abuse, One Victim of Many gmkarl at gmail.com
Fri Jun 17 08:48:27 PDT 2022

Pick-and-place robotics are the primary thing missing for makerspaces
to be able to provide systems that automatically produce prototype
circuit boards.

[for me and likely others on this list, building the robotics and
establishing with the makerspaces is the hard part there; this
tutorial is on the software end]

The simple tutorial moves blocks according to human language.


Conference on Computer Vision and Pattern Recognition 2022 Tutorial on
Vision-based Robot Learning

When: June 20th, 9am to 12pm.
Where: Both in-person and online.

- FlingBot
  - site: https://flingbot.cs.columbia.edu/
  - paper: https://arxiv.org/abs/2105.03655
  - code: https://github.com/columbia-ai-robotics/flingbot
- Implicit Behavioral Cloning
  - site: https://implicitbc.github.io/
  - paper: https://arxiv.org/abs/2109.00137
  - code: https://github.com/google-research/ibc
- NeRF-Supervision
  - site: http://yenchenlin.me/nerf-supervision/
  - paper: https://arxiv.org/abs/2203.01913
  - code: https://github.com/yenchenlin/nerf-supervision-public


(1) Introduce research on Computer Vision for Robotics.

(2) Provide hands-on experience for participants to directly run a
simulated robotics environment via Colab notebook in a browser.

Program / schedule
(times are in New Orleans time -- CDT, GMT /UTC - 06:00)

9:00		Introduction

9:15 		Interactive Tutorial (with colab walkthrough!) -- Learning
Visuomotor Policies Together with Language and Visual-Language Models

Part 1: Introduction to models, environments, data, and begin training.

10:00		Coffee Break

10:15  		Talk: "All the Good Stuff" -- A Toolkit for Vision-Based Robot Learning

10:45		Talk: "Memoirs from a Vision Researcher" -- What I Wish I Knew,
Starting to Work on Robotics

Self-supervised learning and reinforcement Learning

11:15 		Talk: "We Don't Even Need to Train Anymore?" -- Zero-Shotting Robotics

11:45		Interactive Tutorial (with colab walkthrough!) -- Learning
Visuomotor Policies Together with Language and Visual-Language Models

Part 2: Deploy policies, interactive, Q&A

12:15		End!

Animated GIFs

Example Colab Tutorial Walkthrough: Interactive Visuomotor Policies
with Language Models and Visual-Language Models




Implicit Behavioral Cloning




More information about the cypherpunks mailing list