Gran Turismo: an AI explodes the best time of Lewis Hamilton

Last February, Sony AI and Polyphony Digital presented Sophy, a new artificial intelligence for games in the series Gran Turismo. It should eventually replace the current AI, which works thanks to rules, which players find too predictable and whose style driving differs too much from humans.

Sophy’s development continues and has just taken a new step by beating one of Lewis Hamilton’s records. The researchers put it to the test on the North Loop (Nordschleife) of the Nuerburgring in Nuerburg. Over 20 kilometers long, it is considered one of the most demanding circuits in the world. The race takes place in the mode Lewis Hamilton Time Trial Challenge Game Gran Turismo Sports.

A time reached by taking a few shortcuts…

Sony IA released a video of the exploit performed by Sophy. The AI ​​was driving a Sauber mercedes C9 ’89 equipped with tires Race: Hard (CrD). She managed to complete a lap in just 5 minutes and 22.975 seconds, 17 seconds less than the score of Lewis Hamilton, who managed to complete a lap in 5 minutes and 40.622 seconds. The AI ​​achieved this feat by taking a few liberties with the track, frequently going over the grass to gain fractions of a second. Nevertheless, she respected the rules of the game.

Kazunori Yamauchi, creator of the series Gran Turismoindicated that the goal is for Sophy to become ” a teacher who will teach the players how to drive, a student who will learn sportsmanship from the players, and a friend to race with “. This new AI should be available in Gran Turismo 7 via a future update, but no date has yet been announced.

GT Sophy, the AI ​​that dominates real drivers on Gran Turismo

A few weeks before the release of Gran Turismo, Sony unveiled GT Sophy, an artificial intelligence capable of beating the best players in time trials and then in races. Revolutionary to the point of being entitled to the cover of the magazine Naturethis AI is based on reinforcement learning.

Article by Fabrice Auclert, published on 02/10/2022

Which game will resist artificial intelligence? After go, chess or even Starcraft II, it is now the turn of Gran Turismo players to bow to an AI. A few days before the launch of the 7^e edition of the famous simulation automotive from Polyphony Digital, Sony unveiled GT Sophyan artificial intelligence capable of beating the best pilots!

In July, this AI had first beaten the best humans in races against the clock, that is to say, it was alone on the track. But, in October, a milestone was reached since GT Sophy beat human players on a real race with overtaking on the track, but also strategy. Precisely, it is in this area that AI impresses.

Unprecedented driving

” AI rolls in ways we never imagined “, underlines Takuma Miyazono, one of the world references for this video game. Same observation at Kazunori Yamauchi, the creator of Gran Turismo and general manager of the studio, Polyphony Digital, which gives the example of braking in full curve.

” Typically, racing drivers learn to brake in a straight line with the goal of slowing down in the curve to accelerate out of the corner. GT Sophy does not necessarily do this. When it enters a curve, it actually brakes as it enters the curve. Usually, when entering a curve, the load is only on the two front tires; but with GT Sophy you have the load distributed over three tires, two in the front and one in the rear as well. This allows the car to brake while it is turning. »

What distinguishes this AI from others is its type of learning. We thus knew the“deep” learning », and it is already part of our daily life today in research on Internet or the fight against spam. The AI ​​is trained with millions of examples, and then it is able to be autonomous in finding similar images or weeding out spam in our emails. GT Sophy was entitled to it with more than 45,000 hours of learning, based on years of games and stored on a thousand playstation !

The power of reinforcement learning

To complete this machine learning which is very crude, Sony has opted for reinforcement learning (reinforcement learning). It is a type of machine learning used to train AIs to make decisions in an environment with a system of rewards or penalties for each action depending on the results they lead to. This method applied to sports simulation is so relevant and cutting-edge that it is entitled to an article this week and even the cover of the prestigious magazine Nature.

The diagram below shows how an AI interacts with its environment. She takes an action in the world, receives a reward (or penalty) and an updated description of the state of the world to determine her next action. Applied to the car race, it is a question of reacting to the maneuvers of the adversaries, but also to the modifications of the track. The difficulty was becoming aware of the unwritten rules of motor racing, such as avoiding collisions and not cutting corners in dangerous ways.

To challenge GT Sophy, you will unfortunately have to wait since she will not be included in Gran Turismo 7but via a later update. According to experienced pilots who have tested it, its strong point lies in its ability to have a “human” driving style. At no time did they feel like they were challenging a computer that usually operates very mechanically and predictably.