ONSVP-2021: On- and Near-sensor Vision Processing, from Photons to Applications (ONSVP) IEEE International Conference on Robotics and Automation (ICRA) ICRA 2021 Xi'an, China, June 4, 2021 |
Conference website | https://sites.google.com/view/onsvp-icra-2021-workshop/home |
Submission link | https://easychair.org/conferences/?conf=onsvp2021 |
Submission deadline | April 30, 2021 |
Acceptance notification | May 18, 2021 |
Camera-ready version due date | May 28, 2021 |
Almost all real-world AI and robotics applications are power-constrained and depend on a real-time understanding of the robot's environment. Robotic systems that rely on simultaneous localization and mapping (SLAM) and other perception algorithms, would greatly benefit from novel emerging computing paradigms such as computation on or near the focal plane. In this workshop, we explore the emerging unconventional perception methods such as computation directly within the light sensor, performing early-stage recognition before converting signals to digital form, and implementing all or parts of the deep neural networks on the chip. In these methods, only where features of value are identified is data actually transferred to later stages of the vision pipeline. We aim to bring researchers from academia and industry from across multiple disciplines, including i) hardware design, ii) compiler, iii) software/algorithm design, and iv) holistic design to demonstrate the power of novel computational approaches using these unconventional sensors. These novel approaches enable a variety of recognition and tracking applications with exceptionally low latency, high frame rate, and low power.
Several live demos using SCAMP5-d Focal-plane Sensor-processor Arrays (FPSP) will be presented. These demos are:
- BIT-VO: running high-speed visual odometry on SCAMP5-d FPSP
- Neural Sensor: HDR imaging using SCAMP5-d FPSP
- CAIN: demonstrating a new pipeline for compiling CNN kernels to SCAMP5-d FPSP code.
- AnalogNet: a robotic navigation demo using a SCAMP5-d FPSP, capable of navigation in indoor environments avoiding all obstacles, at high frame rate and low power
- Focal Plane Inference: a demonstration of CNN inference performed on the focal plane of a SCAMP5-d for digit recognition.
Submission Guidelines
- The workshop accepts contributions of research papers describing early research on emerging topics.
- The workshop is intended for quick publication of work-in-progress, early results, etc. The workshop is not intended to prevent the later publication of extended papers.
- Prizes will be given to the best paper and also to the best presentation.
- Submission Format: for extended abstracts or full papers, please use standard IEEE format (2-8 pages). For more information, see the IEEE website https://journals.ieeeauthorcenter.ieee.org
The following paper categories are welcome:
- Focal-plane Sensor-processor Arrays
- Computational Sensors
- Smart Vision Sensors
- Event Cameras
- Novel Depth Ranging Sensors
- Compiler Methods for Emerging Sensors
- Application in Robotics and AI
- AI on the Focal Plane
- SLAM on Chip/Focal Plane
- Visual/inertial Odometry on Chip/Focal Plane
- Metrics, Benchmarking, and Datasets for the Emerging Sensors
- Performance Analysis of Algorithms and System using Unconventional Sensors
Committees
Program Committee
- Paul HJ Kelly
- Riku Murai
- Raloca Scona
- Laurie Bose
- Thomas Debrunner
- Edward Stow
Organizing committee
- Sajad Saeedi
- Julien Martel
- Riku Murai
- Paul HJ Kelly
Contact
All questions about submissions should be emailed to icra.workshop@gmail.com