Wireless steerable vision for live insects and insect-scale robots

  title={Wireless steerable vision for live insects and insect-scale robots},
  author={Vikram Iyer and Ali Najafi and Johannes M. James and Sawyer B. Fuller and Shyamnath Gollakota},
  journal={Science Robotics},
A mechanically steerable vision system that imitates insect head motion can be mounted on insects and small robots. Vision serves as an essential sensory input for insects but consumes substantial energy resources. The cost to support sensitive photoreceptors has led many insects to develop high visual acuity in only small retinal regions and evolve to move their visual systems independent of their bodies through head motion. By understanding the trade-offs made by insect vision systems in… 
Towards Sensor Autonomy in Sub-Gram Flying Insect Robots: A Lightweight and Power-Efficient Avionics System
This work presents a sensor package consisting of an inertial measurement unit, a laser rangefinder and an optical sensor, and an associated estimator based on the nonlinear Extended Kalman Filter (EKF), and estimates attitude, altitude and lateral velocities.
Electrostatic footpads enable agile insect-scale soft robots with trajectory control
Key performance attributes in achieving both high mobility and agility to emulate living agile insects for the advancements of soft robots are validated.
Ultrahigh Agility with Trajectory Control of Insect-Scale Soft Robots
Agility and trajectory control are two desirable features for all moving objects but they become very challenging for soft robots without rigid structures to support rapid manipulations. Here, a
Insect-inspired AI for autonomous robots
It is argued that inspiration from insect intelligence is a promising alternative to classic methods in robotics for the artificial intelligence needed for the autonomy of small, mobile robots and that even for neuromorphic processors, one should not simply apply existing AI algorithms but exploit insights from natural insect intelligence to get maximally efficient AI for robot autonomy.
Mechanisms of punctuated vision in fly flight
By studying tethered, flying flies (Drosophila) in a virtual reality flight simulator, it is shown that ballistic head movements (saccades) reset eye position, are stereotyped and leverage elastic recoil of the neck joint, enabling mechanically assisted redirection of gaze.
CameraRoach: A WiFi- and Camera-Enabled Cyborg Cockroach for Search and Rescue
The design and implementation of a cyborg insect with onboard camera feedback that can be navigated via remote control providing a first-person view is described, called CameraRoach, which is mounted on the Madagascar hissing cockroach.
Small Autonomous Robot Actuator (SARA): A Solar-Powered Wireless MEMS Gripper
Solar-powered actuation of a 15 mN electrostatic MEMS gripper was demonstrated while wirelessly triggered by IEEE 802.15.4 RF signals. The solar-powered gripper was shown to actuate at a rate of 640
Airdropping sensor networks from drones and insects
This work designs insect-scale wireless sensors that come fully integrated with an onboard power supply and a lightweight mechanical actuator to detach from the aerial platform, and introduces a first-of-its-kind 37 mg mechanical release mechanism to drop the sensor during flight using only 450 μJ of energy.
SPiDR: ultra-low-power acoustic spatial sensing for micro-robot navigation
This paper presents the design and implementation of SPiDR, an ultra-low-power spatial sensing system for miniature mobile robots. This acoustic sensor produces a cross-sectional map of the
A 5-mm Untethered Crawling Robot via Self-Excited Electrostatic Vibration
This article presents an insect scale, 5-mm-long, and 9.4 mg in body mass untethered crawling robot powered by a 37 mg onboard ceramic capacitor, with high electromechanical efficiency by utilizing self-excited electrostatic vibration.


An Insect-Sized Robot That Uses a Custom-Built Onboard Camera and a Neural Network to Classify and Respond to Visual Input
This work demonstrates a new, custom-built, low-weight camera mounted on a 74 mg flapping-wing robot and implemented a convolution neural network (CNN) to classify images, showing that CNNs operating on input from vision, which have previously been deployed only on larger robots, can be used at insect-scale for such tasks.
Controlled Flight of a Biologically Inspired, Insect-Scale Robot
An 80-milligram, insect-scale, flapping-wing robot modeled loosely on the morphology of flies is built and demonstrated tethered but unconstrained stable hovering and basic controlled flight maneuvers, which validates a sufficient suite of innovations for achieving artificial, insects-like flight.
An actuated gaze stabilization platform for a flapping-wing microrobot
This work designs and fabricated a one degree of freedom mechanism attached to the top of the RoboBee that achieves output angles of −41° to +60°, and demonstrates initial control of the gaze angle during flight, the first use of a camera in free flight at this scale.
Head movements quadruple the range of speeds encoded by the insect motion vision system in hawkmoths
By using its own output to drive compensatory head movements, the motion vision system thereby works as an adaptive sensor, which will be especially beneficial in nocturnal species with inherently slow vision.
Insect-scale fast moving and ultrarobust soft robot
Inspired by nature, this research presents soft robots based on a curved unimorph piezoelectric structure whose relative speed of 20 body lengths per second is the fastest measured among published artificial insect-scale robots.
An autonomous untethered fast soft robotic insect driven by low-voltage dielectric elastomer actuators
This work used low-voltage stacked DEAs with an operating voltage below 450 volts and used them to propel an insect-sized soft untethered and autonomous legged robot to develop a subgram robot capable of autonomous navigation, independently following printed paths.
An Ultralightweight and Living Legged Robot
The robot is a living beetle with a wireless electronic backpack stimulator mounted on its thorax that employs a compliant body made of soft actuators, rigid exoskeletons, and flexure hinges to allow the robot to easily adapt to any complex terrain.
An Ultralightweight and Living Legged Robot.
This robot is a living beetle with a wireless electronic backpack stimulator mounted on its thorax that employs a compliant body made of soft actuators, rigid exoskeletons, and flexure hinges that would allow the robot to easily adapt to any complex terrain.
Liftoff of a 190 mg Laser-Powered Aerial Vehicle: The Lightest Wireless Robot to Fly
A significant milestone in the achievement of flight autonomy is presented: the first wireless liftoff of a 190 mg aerial vehicle that is remotely powered using a 976 nm laser and integrates a complete power electronics package weighing a total of 104 mg, using commercially available components and fabricated using a fast-turnaround laser based circuit fabrication technique.
Toward Autonomy in Sub-Gram Terrestrial Robots
Research toward small, autonomous, and mobile robots is inspired by both the insects we see around us and numerous applications, from inspection of jet engines and civil infrastructure to medical