Robot beats humans in that compelling sport on ice.
This resource, with contextual forces questions, is best suited to year 7 and 10 Physics students who are learning about unbalanced forces and acceleration and have an interest in sport.
Word Count / Video Length: 673 / 0:45 mins
Like most Australians, I know next to nothing about curling. But that doesn’t stop me from watching it religiously at every Winter Olympics. It’s fascinating, like lawn bowls on ice, but with completely changing conditions throughout the game. The best players can assess and compensate for those changes, and even change the ice during the match to perfect their shot (the mad sweeping slightly melts the ice, reducing friction).
But where there’s a sport, someone has tried to build a robot that can play it, and researchers from South Korea and Germany have built a robot that can beat some of the best curlers in the world. The details of “Curly” have been published in the journal Science Robotics by the team from Korea University, Berlin Institute of Technology and the Max Planck Institute for Informatics.
Curling seems like an odd sport to build a robot for, but when it comes to developing advanced AI it’s actually perfect. The environmental characteristics of the ice are constantly changing, and every throw has an impact on the match. Your AI needs to be spot on from the very start, and able to adapt from throw to throw without needing to relearn as the match progresses.
“The curling ice sheet is an environment with highly varying uncertainty that has a large effect on the throw performance. Human players require many years of practice to master the game, which has complex strategic elements and a challenging throw technique,” write the researchers.
The researchers programmed a deep reinforcement learning (DRL) system, a type of AI that learns through trial and error. With uncertainties an unavoidable part of curling, the DRL was able to analyse errors in previous throws during the match and compensate for the changing ice conditions as it went.
Using this DRL system, Curly didn’t need to relearn throws each time – rather, it only needed to complete a couple of calibration throws before each game to detect the starting ice conditions. Then as the game went on, an observer Curly would stand at one end, analysing the position of the rocks and how they moved across the ice. The DRL algorithm would then compensate its approach for the next throw, just as a human would approach the game.
“Unfortunately, Curly takes about 1 to 2 min for one shot, including whole throw procedures such as stone grasp, recognition of own coordinates, strategy planning/adaptation, and throwing and return,” write the researchers.
But it did it well. Curly won three out of four official matches against the South Korean national Women’s and Wheelchair teams. Not bad for a beginner.
Credit: Won et al., Sci Robot. 5, eabb9764 (2020)
Developing systems like Curly isn’t just for picking up Golds though. Because the conditions in curling are so complex and variable, it’s a testbed for building AI that can be transferred to other complex real-world applications, say the researchers.
DRL usually requires a large dataset and substantial computation, and when that has been applied to the real world, it rarely stacks up against the results obtained in simulation. Simply, the world is full of hidden influences and changes that AI struggles, or is unable, to take into account.
And that’s where AI systems like Curly have their advantage. Rather than needing to relearn the conditions constantly, by continuously analysing what is occurring they can quickly, and safely, adapt. That makes them more useful in the real world, where there might not be the opportunity to stop and relearn each time it needs to perform a task.
“The robot can win against top-ranked human players in a curling competition on a real ice sheet. This shows that the approach not only works in simulation but also solves the problem in the real world with all the issues,” writes Johannes Stork, an autonomous robotics expert from Örebro University in Sweden. Stork authored a perspective article about the work, but was not involved in the research.
But really – if the next Olympics features two teams of robots facing off in the curling final… you’d watch the heck out of that, wouldn’t you?
Login or Sign up for FREE to download a copy of the full teacher resource
