Dupuis, Nicholas Kees (2022) Theory of Mind for Multi-agent Coordination in Hanabi. Master's Thesis / Essay, Artificial Intelligence.
|
Text
mAI_2022_DupuisNK.pdf Download (7MB) | Preview |
|
![[img]](https://fse.studenttheses.ub.rug.nl/style/images/fileicons/text.png) |
Text
toestemming.pdf Restricted to Registered users only Download (121kB) |
Abstract
In order to successfully coordinate in complex multi-agent environments, AI systems need the ability to build useful models of others. Building such models often benefits from the use of theory of mind, by representing unobservable mental states of another agent, including their desires, beliefs, and intentions. In this paper I will show how theory of mind affects the ability of agents to coordinate in the cooperative card game Hanabi. The ability to play Hanabi well with a wide range of partners requires reasoning about the beliefs and intentions of other players, which makes Hanabi a perfect testbed for studying theory of mind. I will use both symbolic agent-based models designed to play a simplified version of the game which explicitly engage in theory of mind as well as reinforcement learning agents which use meta-learning to play the full version of the game. Both methods were used to build models of other agents and thereby test how theory of mind can both promote coordination as well as lead to coordination failure. My research demonstrates that the effect of theory of mind is highly variable, and depends heavily on the type of theory of mind reasoning being done by the partner. The empirical results of the agent-based models suggest that theory of mind is best applied when the joint policy produced without theory of mind is far from optimal, in which case second-order theory of mind appears to offer the most significant advantage. Zeroth-order agents are able to...
| Item Type: | Thesis (Master's Thesis / Essay) |
|---|---|
| Supervisor name: | Verbrugge, L.C. and Weerd, H.A. de |
| Degree programme: | Artificial Intelligence |
| Thesis type: | Master's Thesis / Essay |
| Language: | English |
| Date Deposited: | 16 Aug 2022 09:00 |
| Last Modified: | 16 Aug 2022 09:00 |
| URI: | https://fse.studenttheses.ub.rug.nl/id/eprint/28327 |
Actions (login required)
 |
View Item |