This is the third in a multi-part QOMPLX Intelligence series that examines how QOMPLX uses the real-time strategy (RTS) game StarCraft as a training ground for research to support advanced reinforcement learning and effective decision making using machine learning and artificial intelligence. Download a PDF copies of Part 3: Pathfinding in the Fog. We have also provided links to the previous installments of this series below.
In recent posts we've been digging deep into our team's ongoing research and development on machine learning and artificial intelligence. Like other researchers, QOMPLX's team is using Blizzard’s StarCraft real time strategy (RTS) game for experimentation and concept validation in areas like reinforcement learning, multi-agent reinforcement learning techniques, and select experiences in applied research supporting these improved decision-making goals.
Navigating the Fog of War
In our latest installment in this series, we take a look at the problem of pathfinding in StarCraft. As we've noted, StarCraft is a strategy game that presents particular challenges to applying machine learning because it has only partial observability. In contrast to a game like Chess or GO, in other words, StarCraft does not enable players to see the entire play space - at least initially. Instead, large parts of the play space are obscured by what is referred to as the "Fog of War." AI that wants to succeed at StarCraft must learn to navigate this obscured terrain efficiently. That's where "pathfinding" and pathfinding algorithms come in.
Pathfinding is not a new topic, and various algorithms have been developed to tackle the problem. Yet there are still significant challenges and the Fog of War which is usually present in RTS games poses another layer of challenge as features such as terrain obstacles, (static) defensive buildings, and (moving) enemy units need to be learned effectively.
At QOMPLX, we have been working on ways to tackle these challenges using cutting-edge machine learning and artificial intelligence (AI) technologies. In our latest installment in this QOMPLX Intelligence series, we are discussing the pathfinding algorithms themselves and some of the different approaches these algorithms take to pathfinding problems. We also weigh their relative strengths and weaknesses.
Use the download button below or the following link to download and read StarCraft: Pathfinding in the Fog in PDF format.