Google and Facebook Race to Solve the Ancient Game of Go With AI

 

Rémi Coulom spent the last decade building software that can play the ancient game of Go better than practically any other machine on earth. He calls his creation Crazy Stone. Early last year, at the climax of a tournament in Tokyo, it challenged the Go grandmaster Norimoto Yoda, one of the world’s top human players, and it performed remarkably well. In what’s known as the Electric Sage Battle, Crazy Stone beat the grandmaster. But the win came with a caveat.
Over the last 20 years, machines have topped the best humans at so many games of intellectual skill, we now assume computers can beat us at just about anything. But Go—the Eastern version of chess in which two players compete with polished stones on 19-by-19-line grid—remains the exception. Yes, Crazy Stone beat Yoda. But it started with a four-stone advantage. That was the only way to ensure a fair fight.

It's incredibly difficult to build a machine that duplicates the kind of intuition that makes the top human players so good at Go.

In the mid-’90s, a computer program called Chinook beat the world’s top player at the game of checkers. A few years later, IBM’s Deep Blue supercomputer shocked the chess world when it wiped the proverbial floor with world champion Gary Kasparov. And more recently, another IBM machine, Watson, topped the best humans at Jeopardy!, the venerable TV trivia game. Machines have also mastered Othello, Scrabble, backgammon, and poker. But in the wake of Crazy Stone’s victory over Yoda, Coulom predicted that another ten years would pass before a machine could beat a grandmaster without a head start.
At the time, that ten-year runaway seemed rather short. In playing Go, the grandmasters often rely on something that’s closer to intuition than carefully reasoned analysis, and building a machine that duplicates this kind of intuition is enormously difficult. But a new weapon could help computers conquer humans much sooner: deep learning. Inside companies like Google and Facebook, deep learning is proving remarkably adept at recognizing images and grasping spacial patterns—a skill well suited to Go. As they explore so many other opportunities this technology presents, Google and Facebook are also racing to see whether it can finally crack the ancient game.
As Facebook AI researcher Yuandong Tian explains, Go is a classic AI problem—a problem that’s immensely attractive because it’s immensely difficult. The company believes that solving Go will not only help refine the AI that drives its popular social network, but also prove the value of artificial intelligence. Rob Fergus, another Facebook researcher, agrees. “The goal is advancing AI,” he says. But he also acknowledges that the company is driven, at least in a small way, by a friendly rivalry with Google. There’s pride to be found in solving the game of Go.

Building A Brain for Go

Today, Google and Facebook use deep learning to identify the faces in photos you post to the ‘net. It’s how computers recognize the commands barked into a phone and translate things from one language to another. Sometimes, it can even understand natural language—the natural way that we humans converse.
This technology relies on what are called deep neural networks, vast networks of machines that approximate the web of neurons in the human brain. If you feed enough tree photos into these neural nets, they can learn to identify a tree. If you feed them enough dialogue, they can learn to carry on a decent (if sometimes weird) conversation. And if you feed them enough Go moves, they can learn to play Go.

'They learn from how humans play the game and effectively copy human play.'

“Deep neural networks are very appropriate for Go because Go is very driven by patterns on the board. These methods are very good at generalizing from patterns,” says Amos Storkey, a professor at the University of Edinburgh, who is using deep neural networks to tackle Go, much like Google and Facebook.
The belief is that these neural nets can finally close the gap between machines and humans. In playing Go, you see, the grandmasters don’t necessarily examine the results of each possible move. They often play based on how the board looks. With deep learning, researchers can begin to duplicate this approach. In feeding images of successful moves into neural networks, they can help machines learn what a successful move looks like. “Rather than just trying to work out what the best things to do are, they learn from how humans play the game,” Storkey says of neural nets. “They effectively copy human play.”