Please use this identifier to cite or link to this item:
https://hdl.handle.net/11499/46099
Title: | An effective method to use centralized Q-learning in multi-robot task allocation | Authors: | Ezercan Kayir, Hatice Hilal | Keywords: | Multi-Robot systems Task allocation Q-Learning Centralized learning Coordination |
Publisher: | Pamukkale Univ | Abstract: | The use of Q-learning methods in multi-robot systems is a challenging area. Multi-robot systems have dynamic and partially observable nature because of robot's independent decision-making and acting mechanisms. Whereas, Q-learning is defined on Markovian environments theoretically. One way to apply Q-learning in multi robot systems is centralized learning. It learns optimal Q-values for state space of overall system and joint action spaces of all agents. In this case, the system can be considered as stationary and optimal solutions can be converged. But, centralized learning requires full knowledge of the environment, perfect inter-robot communication and good computational power. Especially for large systems, the computational cost becomes huge because of exponentially growing learning space size with the number of robots. The proposed approach in this study, subG-CQL, divides the overall system into small-sized sub-groups without adversely affecting the system's task performing abilities. Each sub-group consists of less number of robots performing less tasks and learns in centralized manner for its own team. So, the learning space dimension is reduced to a reasonable level and required communication remains limited to the robots in the same the sub-group. Due the centralized learning is used, it is expected that the successful results are achieved. Experimental studies show that the proposed algorithm provides increase in the task assignment performance of the system and efficient use of system resources. | URI: | https://doi.org/10.5505/pajes.2021.90490 https://search.trdizin.gov.tr/yayin/detay/488099 https://hdl.handle.net/11499/46099 |
ISSN: | 1300-7009 2147-5881 |
Appears in Collections: | Mühendislik Fakültesi Koleksiyonu TR Dizin İndeksli Yayınlar Koleksiyonu / TR Dizin Indexed Publications Collection WoS İndeksli Yayınlar Koleksiyonu / WoS Indexed Publications Collection |
Files in This Item:
File | Size | Format | |
---|---|---|---|
PAJES-90490-RESEARCH_ARTICLE-EZERCAN_KAYIR.pdf | 873.79 kB | Adobe PDF | View/Open |
CORE Recommender
Page view(s)
22
checked on Aug 9, 2024
Download(s)
12
checked on Aug 9, 2024
Google ScholarTM
Check
Altmetric
Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.