911�Թ�

Who’s a ‘Good Boy?’ Astro, 911�Թ�’s Smart Robodog That’s Who

Using deep learning and artificial intelligence (AI), 911�Թ� scientists are bringing to life one of about a handful of these quadruped robots in the world. Astro is unique because he is the only one of these robots with a head, 3D printed to resemble a Doberman pinscher, that contains a (computerized) brain. (Photo by Alex Dolce)

---

What would you get if you combined Amazon’s Alexa with an open source quadruped robot? You’d get “Astro,” the four-legged seeing and hearing intelligent robodog.

Using deep learning and artificial intelligence (AI), scientists from ’s Machine Perception and Cognitive Robotics Laboratory () in the in 911�Թ�’s are bringing to life one of about a handful of these quadruped robots in the world. Astro is unique because he is the only one of these robots with a head, 3D printed to resemble a Doberman pinscher, that contains a (computerized) brain.

Astro not only looks like a dog; he learns like one too. That’s because he doesn’t operate based on preprogrammed robotic automation. Instead, Astro is being trained using inputs to a deep neural network –��a computerized simulation of a brain – so that he can learn from experience to perform human-like tasks, or on his case, “doggie-like” tasks, that benefit humanity.

��

Equipped with sensors, high-tech radar imaging, cameras and a directional microphone, this 60-pound super robot is still a “puppy-in-training.” Just like a regular dog, he responds to commands such as “sit,” “stand” and “lie down.” Eventually, he will be able to understand and respond to hand signals, detect different colors, comprehend many languages, coordinate his efforts with drones, distinguish human faces, and even recognize other dogs. ��

As an information scout, Astro’s key missions will include detecting guns, explosives and gun residue to assist police, the military, and security personnel. This robodog’s talents won’t just end there, he also can be programmed to assist as a service dog for the visually impaired or to provide medical diagnostic monitoring. The MPCR team also is training Astro to serve as a first responder for search and rescue missions such as hurricane reconnaissance as well as military maneuvers.

Martin Woodall, founder of DroneData and a visionary in the field of GPU accelerated servers, is sponsoring the robotic project at 911�Թ�. This project is a collaboration between��DroneData AstroRobotics division and��911�Թ�'s MPCR laboratory.��AstroRobotics has provided the��GhostRobotics��open source robotic Four Leg All-Terrain Edge Compute Platform��for the��911�Թ� designed software.��

Designed to engage and react to the world around him in real-time, this intelligent machine will be able to navigate through rough terrains and respond to dangerous situations to keep humans and animals out of harm’s way. Astro will be outfitted with more than a dozen sensors that will consume environmental input across multiple modalities including optical, sound, gas and even radar. To process the sensory inputs and make autonomous behavioral decisions, a set of Nvidia Jetson TX2 graphics processing units are onboard with a combined four teraflops of computing power, which amounts to about four trillion computations a second. This robodog will be able to rapidly see and search thousands of faces in a database, smell the air to detect foreign substances, and hear and respond to distress calls that fall outside a human’s audible hearing range. 911�Թ�’s MPCR team will program Astro to have an extensive database of experiences that he can draw upon to help him make immediate decisions on the go.

The human brains behind Astro are a team of neuroscientists, IT experts, artists, biologists, psychologists, high school students and undergraduate and graduate students at 911�Թ�. At the helm of this project are , Ph.D., an associate professor in 911�Թ�’s , co-director of 911�Թ�’s MPCR laboratory, and a member of 911�Թ�’s Brain Institute (), one of the university’s four research pillars; , Ph.D., an assistant professor in 911�Թ�’s and co-director of 911�Թ�’s MPCR laboratory; and Pedram Nimreezi, director of intelligent software in 911�Թ�’s MPCR laboratory, chief technology officer for RedGage and a martial arts expert.

“Our Machine Perception and Cognitive Robotics laboratory team was sought out by DroneData’s AstroRobotics group because of their extensive expertise in cognitive neuroscience, which includes behavioral, neurophysiological and embedded computational approaches to studying the brain,” said , Ph.D., dean of 911�Թ�’s Charles E. Schmidt College of Science. “Astro is inspired by the human brain and he has come to life through machine learning and artificial intelligence, which is proving to be an invaluable resource in helping to solve some of the world’s most complex problems.”

-911�Թ�-

Tags: jupiter | engineering | faculty and staff | students | technology | science | research