IRMA-International.org: Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Task Coordination for Service Robots Based on Multiple Markov Decision Processes

Task Coordination for Service Robots Based on Multiple Markov Decision Processes
View Sample PDF
Author(s): Elva Corona (National Institute of Astrophysics, Optics and Electronics, Mexico)and L. Enrique Sucar (National Institute of Astrophysics, Optics and Electronics, Mexico)
Copyright: 2014
Pages: 18
Source title: Robotics: Concepts, Methodologies, Tools, and Applications
Source Author(s)/Editor(s): Information Resources Management Association (USA)
DOI: 10.4018/978-1-4666-4607-0.ch002

Purchase

View Task Coordination for Service Robots Based on Multiple Markov Decision Processes on the publisher's website for pricing and purchasing information.

Abstract

Markov Decision Processes (MDPs) provide a principled framework for planing under uncertainty. However, in general they assume a single action per decision epoch. In service robot applications, multiple tasks are required simultaneously, such as navigation, localization and interaction. We have developed a novel framework based on functional decomposition that divides a complex problem into several sub-problems. Each sub-problem is defined as an MDP and solved independently, and their individual policies are combined to obtain a global policy. In contrast to most previous approaches for hierarchical MDPs, in our approach all the MDPs work in parallel, so we obtain a reactive system based on a decision theoretic framework. We initially solved each MDP independently and combined their policies assuming no conflicts. Then we defined two kinds of conflicts, resource and behavior conflicts, and proposed solutions for both. The first kind of conflict is solved off-line using a two phase process which guarantees a near-optimal global policy. Behavior conflicts are solved on-line based on a set of restrictions specified by the user, and a constraint satisfaction module that selects the action set with higher expected utility. We have used these methods for task coordination in service robots, and present experimental results for a messenger robot.

Related Content

Rashmi Rani Samantaray, Zahira Tabassum, Abdul Azeez. © 2024. 32 pages.
Sanjana Prasad, Deepashree Rajendra Prasad. © 2024. 25 pages.
Deepak Varadam, Sahana P. Shankar, Aryan Bharadwaj, Tanvi Saxena, Sarthak Agrawal, Shraddha Dayananda. © 2024. 24 pages.
Tarun Kumar Vashishth, Vikas Sharma, Kewal Krishan Sharma, Bhupendra Kumar, Sachin Chaudhary, Rajneesh Panwar. © 2024. 29 pages.
Mrutyunjaya S. Hiremath, Rajashekhar C. Biradar. © 2024. 30 pages.
C. L. Chayalakshmi, Mahabaleshwar S. Kakkasageri, Rajani S. Pujar, Nayana Hegde. © 2024. 30 pages.
Amit Kumar Tyagi. © 2024. 29 pages.
Body Bottom