====== CIG 2012 ====== ===== CIG 2012 StarCraft RTS AI Competition ===== /* [[http://geneura.ugr.es/cig2012/competitions.html|{{ :rts-competition:competition2011-banner.jpg?300}}]] */ Over the last years, the [[http://webdocs.cs.ualberta.ca/~cdavid/starcraftaicomp|AIIDE]] and [[http://geneura.ugr.es/cig2012/competitions.html|CIG]] StarCraft competitions have seen quite some progress in the development and evolution of new StarCraft bots. Still, these would not be fit for beating expert human players, but the gap is seemingly getting smaller. StarCraft (by Blizzard) is one of the most popular RTS games of all time, is known to be extremely well balanced, and thus is an ideal candidate to test different AI approaches. This competition is part of the [[http://geneura.ugr.es/cig2012/|Computational Intelligence in Games conference 2012]]. ===== Important Dates ===== ^ ^ ^ |Submission deadline: |August 15, 2012|\\ |Conference: |September 12 - September 15, 2012|\\ If you have any questions or comments, please let us know via mail [[starcraft@ls11.cs.tu-dortmund.de]]. ===== Submitted Bots ===== /* [[:rts-competition:starcraft-cig2011:submitted-bots|(see an extended description of the bots here:)]]\\ */ ^ Bot Name ^ Main Contributor ^ Institution ^ Bot Race ^ Web Link^ |BroodwarBotQ|Gabriel Synnaeve|INRIA, Collège de France|Protoss|http://emotion.inrialpes.fr/people/synnaeve| |Xelnaga|Ho-Chul Cho|Sejong University|Protoss| | |BTHAI|Johan Hagelbäck|Blekinge Institute of Technology|Terran|http://code.google.com/p/bthai/| |SCAIL|Jay Young|The University of Birmingham, UK|Protoss|http://www.cs.bham.ac.uk/~jxy734/|\\ |Skynet|Andrew Smith|freelancer|Protoss|http://code.google.com/p/skynetbot/|\\ |AIUR|Florian Richoux|University of Nantes|Protoss|http://code.google.com/p/aiurproject/|\\ |Adjutant|Nicholas Bowen|University of Central Florida|Terran|http://code.google.com/p/adjutantbot/|\\ |IceBot|Wang Zhe|Ritsumeikan University|Terran| \\ |UAlbertaBot|David Churchill|University of Alberta, Canada|Protoss|http://webdocs.cs.ualberta.ca/~cdavid/|\\ |Nova|Alberto Uriarte|Drexel University|Terran|http://nova.wolfwork.com|\\ ===== Results ===== The results {{:rts-competition:cig2012stcomp2.pptx|presentation}} as held on the CIG 2012 provides a good overview and some insights. The final standing is: ^ Rank ^ Bot Name ^ Main Contributor ^ Win Rate ^ Avg Frames ^ 1h Timeouts ^ Crahses ^ Timeouts ^ |1|Skynet|Andrew Smith| 0.787| 14371.61| 4| 99| 16| |2|UAlbertaBot|David Churchill| 0.655| 15734.90| 24| 106| 9| |3|AIUR|Florian Richoux| 0.609| 19488.85| 47| 114| 29| |4|Adjutant|Nicholas Bowen|0.587| 22451.56| 61| 97| 33| |5|Nova|Alberto Uriarte|0.531| 23265.75| 53| 111| 25| |6|Xelnaga|Ho-Chul Cho|0.512| 21570.69| 42| 116| 23| |7|BroodwarBotQ|Gabriel Synnaeve|0.479| 21521.37| 58| 221| 13| |8|SCAIL|Jay Young|0.350| 23749.38| 59| 97| 8| |9|IceBot|Wang Zhe|0.292| 24123.53| 77| 280| 11| |10|BTHAI|Johan Hagelbäck|0.199|19782.25| 25| 135| 22| Each of the 6 maps has been played on 675 times, 15 times by each bot-bot combination. Each bot thus played 810 games. We used 6 client computers, but most of the games (around 50%) were actually played on just 2 of them. As we did not have a network drive available, all reading/writing to disk by the bots was only local (on the computer currently used by the bot). We apologize for this. {{ :rts-competition:vstable.png?direct&100|Matrix plot of how the bots played against each other}} The plot on the right (click to increase size) documents how the bots fared against the specific opponents. Note that Xelnaga is the only bot that regularly beats Skynet, whether Nova is especially strong against the UAlbertaBot. Some bots know their enemies... :-) {{:rts-competition:out.txt|Raw text output of result analyser}} {{:rts-competition:cig2012-replays.zip|Replays of all 4050 played games}} Please note: there are at least 2 games where 3 players entered, which is to be considered as technical problem. However, we presume this did not affect the results very much. Here are the {{:rts-competition:2-replays-xelnaga-skynet-nova-ualbertabot.zip|2 replays}} shown in the presentation: Xelnaga surprising Skynet with a targetted DTS attack on its probes, and Nova successfully luring UAlbertaBot's probes into its own base. All the numbers have been computed using the tournament software provided by the AIIDE 2012 StarCraft competition team of the University of Alberta, Canada, namely Michael Buro, David Churchill, Jason Lorenz. Many thanks again! ===== Getting Started ===== The competition will use StarCraft Brood War 1.16.1. You must possess a legal copy of the game. Bots for StarCraft shall use the [[http://code.google.com/p/bwapi|Broodwar API]], which provides hooks into StarCraft and enables the development of custom AI for StarCraft. Interfaces in many languages are available to query the current state of the game and issue orders to units. As of now, we expect all bots to use BWAPI version 3.7.3 which as also the version planned for the AIIDE tournament. However, there is a slight chance of an emergency bug fix to the BWAPI (such as happened last year) so that we need to switch to a newer version. [[http://code.google.com/p/bwapi/|{{ http://bwapi.googlecode.com/svn/wiki/bwapi3.jpg?250}}]] The following material is a bit outdated, as it was prepared by Ben Weber for the AIIDE StarCraft competition in 2010 (and not everything has been updated since then). However, it still provides a valuable starting point if you want to start designing and implementing a bot from scratch. Please note, that the referenced BWAPI versions are not used any more for our competition (we go with BWAPI 3.7.4 which has been issued in early July, 2012 and fixes some tournament-related issues with 3.7.3): * Instructions for setting up the environment are available [[http://eis.ucsc.edu/StarCraftBWAPI|here]].\\ * An introduction to the Broodwar API is available [[http://eis.ucsc.edu/StarCraftUsingBWAPI|here]].\\ * Instructions for building a bot that communicates with a remote process are available [[http://eis.ucsc.edu/StarCraftRemote|here]].\\ * A JNI (Java) bridge to the BWapi by Ben Weber is available [[http://code.google.com/p/jnibwapi/|here]].\\ === Rules === Due to lack of participation last year there will be only one track this year (formerly called "Track A"). Detailed rules are [[ruleset2012|here]]. This year, we will use the tournament software of the [[http://webdocs.cs.ualberta.ca/~cdavid/starcraftaicomp/|AIIDE competition]], provided by Michael Buro, David Churchill and Jason Lorenz (many thanks, guys!). We will therefore have only one bracket and will play as many repetitions of round-robin as possible. Note that time constraints are quite hard and a large tolerance (1 min) applies only for the first frame to allow loading data and setting up. The new version of the tournament software enables to use a persistent data store so that learning over multiple games gets possible. /* Baseline (tentative) [[http://skatgame.net/mburo/sc2011/rules2.html|ruleset]] (the same as for the AIIDE competition, it basically defines what misbehavior of a bot is that would lead to disqualification). */ === Maps === We use a collection of 6 maps, 3 of which have 3 spawn points, and the other 3 have 6 spawn points. All maps have size 128x128 as some of the bots experience problems with other map sizes. == 3 Player Maps == |{{:rts-competition:athena-2.jpg?120}}|{{:rts-competition:neomoonglaive.jpg?120}}|{{:rts-competition:tearsofthemoon.jpg?120}}|\\ |Athena II|Neo Moon Glaive|Tears of the Moon|\\ == 6 Player Maps == |{{:rts-competition:legacy.jpg?120}}|{{:rts-competition:riveroflight.jpg?120}}|{{:rts-competition:thehuntress.jpg?120}}|\\ |Legacy|River of Light|The Huntress 1.1|\\ /* We will largely use a pool of maps widely used for internet gaming, as e.g. the maps of the [[http://www.iccup.com/starcraft/files/view/iCCup_maps.html|International Cyber Cup]], thus we recommend using some of these also for training your bots. */ /* Here are two test maps (largely generated, some fixes done manually) that may serve to train your bots, we will use similar (not equal) maps for the competition. |{{:rts-competition:map1.jpg?120}}|{{:rts-competition:map2.jpg?120}}|\\ |{{:rts-competition:training-map1.zip }}|{{:rts-competition:training-map2.zip}}|\\ */ ===== Additional Information ===== === Links === [[http://webdocs.cs.ualberta.ca/~cdavid/starcraftaicomp/|AIIDE'12 Starcraft AI Competition]]\\ [[http://ls11-www.cs.tu-dortmund.de/rts-competition/starcraft-cig2011/|CIG 2011 StarCraft RTS AI Competition]] === Organizing Committee === Tobias Mahlmann, IT University Copenhagen\\ Mike Preuss, Technische Universität Dortmund\\ For any comments or inquiries, please write to [[starcraft@ls11.cs.tu-dortmund.de]]\\ === Legal === {{ http://eis.ucsc.edu/sites/default/files/blizzard.gif?180}} StarCraft®: Brood War®\\ Used with permission granted to [[http://geneura.ugr.es/cig2012/|CIG]]. Blizzard has consented to run the competition via the Broodwar API interface, which uses a back door of the game and is not in any form related to Blizzard. Thanks! ©1998 Blizzard Entertainment, Inc. All rights reserved. StarCraft, Brood War and Blizzard Entertainment are trademarks or registered trademarks of Blizzard Entertainment, Inc. in the U.S. and/or other countries.