IRMA-International.org: Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Task Coordination for Service Robots Based on Multiple Markov Decision Processes

Task Coordination for Service Robots Based on Multiple Markov Decision Processes
View Sample PDF
Author(s): Elva Corona (National Institute of Astrophysics, Optics and Electronics, Mexico)and L. Enrique Sucar (National Institute of Astrophysics, Optics and Electronics, Mexico)
Copyright: 2014
Pages: 18
Source title: Robotics: Concepts, Methodologies, Tools, and Applications
Source Author(s)/Editor(s): Information Resources Management Association (USA)
DOI: 10.4018/978-1-4666-4607-0.ch002

Purchase

View Task Coordination for Service Robots Based on Multiple Markov Decision Processes on the publisher's website for pricing and purchasing information.

Abstract

Markov Decision Processes (MDPs) provide a principled framework for planing under uncertainty. However, in general they assume a single action per decision epoch. In service robot applications, multiple tasks are required simultaneously, such as navigation, localization and interaction. We have developed a novel framework based on functional decomposition that divides a complex problem into several sub-problems. Each sub-problem is defined as an MDP and solved independently, and their individual policies are combined to obtain a global policy. In contrast to most previous approaches for hierarchical MDPs, in our approach all the MDPs work in parallel, so we obtain a reactive system based on a decision theoretic framework. We initially solved each MDP independently and combined their policies assuming no conflicts. Then we defined two kinds of conflicts, resource and behavior conflicts, and proposed solutions for both. The first kind of conflict is solved off-line using a two phase process which guarantees a near-optimal global policy. Behavior conflicts are solved on-line based on a set of restrictions specified by the user, and a constraint satisfaction module that selects the action set with higher expected utility. We have used these methods for task coordination in service robots, and present experimental results for a messenger robot.

Related Content

Brij B. Gupta, Akshat Gaurav, Francesco Colace. © 2025. 16 pages.
Akshat Gaurav, Varsha Arya. © 2025. 16 pages.
Brij B. Gupta, Jinsong Wu. © 2025. 22 pages.
Purwadi Agus Darwinto, Agung Mulyo Widodo, Nilla Perdana Agustina, Kadek Dwi Wahyuadnyana, Mosiur Rahaman. © 2025. 30 pages.
Mosiur Rahaman, Karisma Trinda Putra, Bambang Irawan, Totok Ruki Biyanto. © 2025. 30 pages.
Shaurya Katna, Sunil K. Singh, Sudhakar Kumar, Divyansh Manro, Amit Chhabra, Sunil Kumar Sharma. © 2025. 22 pages.
Kwok Tai Chui, Varsha Arya, Akshat Gaurav, Shavi Bansal, Ritika Bansal. © 2025. 22 pages.
Body Bottom