Herself’s Artificial Intelligence

I am finishing up my reading of ‘The Magic Machine: A Handbook of Computer Sorcery‘ and there were only two programs left to write. I thought I’d wipe the first one out in a day. Heh, it took three.

In a chapter of the book the author discusses early attempts at genetically evolving artificial life. He gives a rough algorithm and states he had all kinds of critters running around in just a few hundred generations. I loosely wrote a program based on his algorithm. 150,000+ cycles, and 36 hours on my computer later, no evolution. I don’t know how he did it? I couldn’t get the algorithm in the book to produce any interesting results.

I did today get a program that has bugs that learn to stay on and follow food lines drawn in the window. It takes about 1500 days ( cycles ) for them to achieve this universally. The source code is linked to below.

Here’s what I learned in my attempts at a very simple genetic program.

If you place food randomly there is nothing to learn. You just end up with a population of stupid bugs. Adjusting the food nutrient content worked better than adjusting the amount of food for controlling population levels and for evolution. Creating more food to meet the population just created lots of stupid bugs. ( I wonder if there is a real life lesson in that? )

If you adjust the bugs DNA when they find food, not just their energy levels they learn much faster.

I hope to do some more complex and interesting evolution programs soon.

Source Code:
Bugs.java

See also
Evolutionary AI for more information and several useful links and papers to get you started.
SantaFe Ants

All these recent studies using neural networks to predict human behavior have found a purpose. They are being trained and used on game users computers to get around network lag in games by predicting the gamers next move.

Lag time is the ping time between you and the game computer. If two players are shooting at each other, he with the shortest ping time ( lag time ) wins. This can be frustrating for people whose networks lag. The neural network will level the playing field.

Gamers know the problem well: in the middle of an awesome, fast-paced battle, the action onscreen becomes slow and jerky. Suddenly, your character turns up dead, and you didn’t see who did it. In massively multiplayer online games, the problem of lag arises when a player’s computer can’t keep up with changes in a shared online world–and it can turn euphoria into frustration. New software being designed at the National University of Ireland, Maynooth, could help reduce the problem and may also have applications in military simulations. . . [ read more Reducing lag time in online games]

Also interested , as always, is Darpa who hopes to use this technology to improve military battle simulations.

More information:
Neuro-Reckoning may reduce mmog time lag
Multistep ahead neural network predictors for network traffic reduction in distributed interactive applications

Designing AI Algorithms for Turn-Based Strategy Games

In action games the AI opponent always has the natural advantage: perfect accuracy and lightning fast reflexes, so the challenge in designing the AI for those games is making it act more human and to be beatable.

In turn-based strategy games the tables are turned. Speed and accuracy are no longer important factors and the cunning and intuition of the human player will easily out match any AI opponent. In fact, it’s nearly impossible to design a AI that can beat an experienced player, but that is not really the point anyway.

The challenge is to make the AI’s attack and defense strategy to appear intelligent and thought out, providing a challenge but letting the player win in the end. Once the player has familiarized himself/herself with the tactics of the AI the game rapidly gets boring, so a certain amount of unpredictability is desirable. . . .

I ran across this article while looking into predator prey chases and thought it might be of interest to some of you.

See also:
Simple predator prey chase algorithms
Predator prey chases using potential functions