ASU’s Robotic Dogs Learn to Save Lives and Guide the Visually Impaired

Meet the Unitree Go2. This agile, quadrupedal robot is designed for more than simply fetching sticks. It's equipped with advanced artificial intelligence cameras, LiDAR, and a voice interface, and it's learning how to assist with everything from search-and-rescue missions to guiding the visually impaired through complex environments.

Ransalu Senanayake, an assistant professor of computer science and engineering in ASU's School of Computing and Augmented Intelligence, is leading the research team to prove that some heroes have both circuits and tails. 

LENS Lab unleashes the future of robotics

Senanayake is a roboticist who has founded the Laboratory for Learning Evaluation and Naturalization of Systems, also known as the LENS Lab. He has a vision to enhance human well-being by developing intelligent robots that can assist in real-world scenarios.

"We're not just writing code for robots," he says. "We're creating tools to solve problems that matter, like saving lives in dangerous environments and making the world more accessible."

The LENS Lab team is pushing the boundaries of robotics by incorporating AI models that enable the robot to understand and adapt to its environment, making it ready for real-world applications.

"AI breakthroughs are finally turning robots into a feasible, ubiquitous reality," Senanayake says. "We are teaching our robots to see, hear and move in complex environments, making them useful in a variety of situations."

Sit, stay, innovate

The team is working on multiple projects using the Unitree Go2 robotic dog. One of the lab's most exciting projects is led by Eren Sadıkoğlu, a student pursuing a master's degree in robotics and autonomous systems, who is developing vision and language-guided navigation tools to help the robotic dog perform search-and-rescue missions.

Sadıkoğlu, who says he has been passionate about robotics since middle school, is using reinforcement learning to teach the robot how to navigate challenging environments, such as those following a natural disaster like an earthquake.

"The robots need to jump over obstacles, duck under things and do some acrobatic movements," Sadıkoğlu says. "It's not just about moving from point A to point B. It's about moving safely and strategically through difficult terrain."

Thanks to the robot's AI-powered advanced sensors, such as RGB-depth cameras and touch sensors on the robot's feet, it can adapt to and navigate the unpredictable conditions within disaster zones.

"This research is about making robots that can go where humans can't, keeping rescue teams safe while saving lives," Sadıkoğlu says.

4 paws for a good cause

ASU undergraduate student Riana Chatterjee, in the computer science program, is also contributing to the future of robotics with her project, which aims to assist the visually impaired. Chatterjee is developing AI-powered algorithms that enable the robot dog to guide individuals safely through both indoor and outdoor spaces.

"My project is about combining deep learning technologies to enable the robot to understand its surroundings and communicate that to a visually impaired person," Chatterjee says.

Chatterjee's work blends emerging AI technologies. She is using You Only Look Once, or YOLO. This computer vision model enables the robot to quickly recognize and classify objects in its environment, distinguishing between a person, a wall, or an obstacle. She is also leveraging transformer-based monocular depth estimation, which enables the robot to gauge the distance of objects and navigate safely and accurately.

Finally, the project utilizes vision language models, or VLMs, enabling the robot to interpret what it sees and respond with language to communicate with the visually impaired person, describing their surroundings or offering guidance.

Chatterjee's work could have a considerable impact. Future robots can act as a guide, identifying obstacles and walkable areas, serving as service dogs in environments where real animals are impractical.

"For me, robotics is about making life easier for people with impairments. It's fascinating to think about how AI can change the lives of those who need it the most," she says.

Unleashing the future of robotics

Senanayake believes that robotics and AI have the potential to transform our world.

He envisions robots being a regular part of our daily lives, helping around the house, assisting in critical missions, and opening up new possibilities for accessibility.

"The future of robotics is exciting, and I hope that with our research, we'll be able to bring these technologies into the homes and communities that need them most," he says.

As AI and robotics continue to evolve, Ross Maciejewski, director of the School of Computing and Augmented Intelligence, emphasizes the school's commitment to fostering innovation and providing students with a rigorous, project-driven curriculum that prepares them for the rapidly changing high-tech landscape.

"Our goal is to equip students with both the theoretical foundations and practical skills needed to tackle the challenges of tomorrow," Maciejewski says. "By blending AI with robotics, we are not only expanding the capabilities of technology but also creating future leaders who will bring transformative solutions to critical issues."

Who knows? Your next helpful pooch may just be a robot.

WiFido? Spark-E? Help name ASU's robotic best friend!

Help choose the perfect name for ASU's four-legged AI companion! Vote over in the Instagram stories at ASUEngineering.