Projects

In the past decade we have seen a tremendous growth of interest in autonomous vehicles. Many companies have been conducting research and testing on the streets such as Waymo, Cruise, and Tesla. These companies tend to focus on traditional passenger vehicles and have achieved good results in structured environments such as highway driving. However, autonomous driving in dense urban areas remains a challenge that has yet to be solved. The goal of this project is to focus on dense urban settings (such as campus) and rather than using a car we have elected to automate an E-Scooter. By simply walking around campus and other parts of San Diego you can see that these electric scooters are littered everywhere. However, these scooters are often only used a couple times per day before being left on the ground at which point they must be picked up by a company representative and placed back in their original locations. Imagine now if instead, the scooter was capable of being summoned to your location via app, driving itself back after dropping you off, and even able to drive itself to charging stations when necessary! Read more.

Motion prediction and planning are typically treated as two separate tasks in the autonomous driving community. Despite significant advancements in motion prediction, integrating these models into safety-critical planning systems remains challenging. In this project, we aim to develop an autonomous driving planning system that optimizes reactive motion prediction and planning objectives jointly.

CHASER project aims to advance autonomous systems by enabling seamless interaction with humans, leveraging fundamental principles of robotics. This initiative seeks to integrate “follow-me” capabilities and artificial intelligence allowing users to command the robot through human-level natural language interactions. The project envisions an AI system akin to a ChatGPT agent embedded within the robot to facilitate intuitive, conversational communication. Building upon a robust autonomous framework, CHASER incorporates functionalities such as mapping and navigation in both indoor and outdoor environments. The overarching goal of this project is to develop a robot that collaborates with humans to accomplish tasks, emphasizing partnership and augmentation rather than human replacement.

Autonomous vehicles have tremendous social and economic values for society. But before we can see large-scale deployment, its perception systems need to make significant progress in robustness and generalization capability. To address these challenges, we bring context, the semantic meaning into the robot perception. Our approach is to conduct research on our full-scale testing vehicles, our living laboratory. We evaluate the state-of-the-art algorithms, search for and address the challenges we found in real-world deployment. Such challenges include long term tracking and prediction of road users, dynamic scene modeling and dynamic planning. Read more.

Interactions in dynamic environments require planning of actions to allow for intelligent interaction for manipulation of objects. Dynamic interaction with the environment not only includes basic mobility but also the ability to modify the environment through manipulation for assembly, logistics and simple clean-up. The research primarily focuses on task and motion planning for reliable and efficient manipulation actions in dynamic environments for home robots. It includes both basic physical interaction and mobile manipulation. For handling of unexpected objects and situations, there is also a need to consider ad-hoc planning to recover from surprises or un-modelled events.

The overall objective of the project is to design a navigation framework for a fleet of robots which is scalable, robust, and safe. The main component of the control framework to ensure safety is based on a control barrier function approach. Additionally, the project aims to investigate whether a centralized or decentralized approach for control and planning results in safer work conditions.

Many tasks in the real world require teams composed of multiple robots to work together. For example, in the security domain, multiple robots can continuously monitor a physical perimeter to detect intrusions. Solving multi-robot problems, however, introduces several key challenges, such as learning and acting in the presence of other actors who may introduce added complexity by altering their behaviors. This research area spans a large spectrum from traditional game-theoretic methods, to the application of multi-agent reinforcement learning, to develop solutions to multi-robot tasks such as multi-robot patrolling and pursuit-evasion.

Our project aims to develop novel reinforcement learning frameworks that enable robots to visually adapt in dynamic robot manipulation and locomotion tasks. By combining advanced computer vision techniques with adaptive reinforcement learning algorithms, we train robots to generalize across diverse visual and physical conditions through techniques like self-supervised representation learning, and domain randomization.

A key feature of modern robots operating in human-centric environments is the ability to estimate scene layout, and also associate semantics with scene components, to allow for contextual interaction. Intelligent robots for both in-door and out-door environments, heavily require interpretation of the surrounding to facilitate interaction and planning. We aim to leverage foundational concepts of geometric localization and mapping from classical robotics, along with recent developments in learning-based techniques for retrieving context and scene knowledge, in order to develop smart algorithms for tasks such as semantic scene understanding, mapping, and robot navigation.