Skip to Content

Look out, this poker-playing computer is unbeatable

January 8, 2015

Researchers have developed a computer program they say can beat any human on the planet at a particular variant of Texas Hold’em poker.

The scientists aren’t planning to clean up with their powerful poker bot. Instead, they hope it can help computers become better decision-makers in the face of uncertainty. The work is published Thursday in the journal Science.

Poker players know the game is a mixture of luck, statistics and psychology. You need to know your odds and know whether your opponent is bluffing. In the words of Kenny Rogers, “You’ve got to know when to hold ’em, know when to fold ’em.”

The variety of strategies one can use to play poker is truly immense, according to Michael Bowling, a computer scientist at the University of Alberta in Canada who invented the new program.

“There are … 10 trillion different decision points in the game,” Bowling says. “So the actual number of ways of playing is an astronomically large number.”

But in the case of Heads-up Limit Texas Hold’em (a variant in which there are only two players and the betting is capped) one of these trillions of strategies can beat all the others.

It doesn’t matter if the human opponent is a master bluffer, or a blundering amateur, Bowling says — a computer using that single best strategy can eventually win.

It took Bowling years to find that winning approach. His team had to crunch the strategies with supercomputers. The final push for the ultimate strategy was crunched by a computing cluster made of nearly 5,000 CPUs, according to Michael Johanson, a graduate student on the project. It took the cluster more than two months to find the answer, Johanson says. “Almost a thousand years of computation went into this.”

But at the end of all that, they had the perfect strategy, the scientists say. Well, almost perfect.

“It’s just a tiny bit off,” Bowling says. “And that tiny bit is so small that even if you played a lifetime — 12 hours a day, 200 hands an hour for 70 years — you still wouldn’t be able to tell it apart from having played a perfect game.”

The strategy confirms several long-held beliefs among poker players. For example, the program will always raise the stakes if it has a reasonable hand and is the first to bet.

But the computer program also showed some surprises. It often bets even when it holds a pair of low-ranked cards like fours and threes, according to Bowling. Many professional players would fold, or at least call, with such a weak hand.

Bowling says the program isn’t much of a threat to online gamblers. Heads-up Limit Hold’em is not the variety of poker most people play. But he does believe that “poker bots” are trying to win in online game rooms. “My guess is there are probably quite strong poker bots out there,” he says. “But you’re not going to hear a lot of talk about them.”

He hopes the program he’s developed can help make computers generally better at making decisions, when faced with uncertainty.

Oren Etzioni, the head of Seattle’s Allen Institute for Artificial Intelligence, says the new program is breakthrough. Etzioni notes that computers now have beaten humans at chess, checkers, backgammon and even Jeopardy!

But he says humans still have an edge: Each game-winning computer involves “very, very different computer software,” he says. In other words, they’re highly specialized tricks for winning at particular games.

“The human,” Etzioni says, “is still eons ahead of these computer programs in general intelligence.”

Copyright 2015 NPR. To see more, visit http://www.npr.org/.

Our lives have changed ...

CPR will not compromise in serving you and our community. Vital news and essential music are made possible by member support.

Donate

Experiencing and Confronting Bias

Recently on the national program The Takeaway, former CPR journalist Lee Hill shared his experience from his time here. Hill’s story, as well as feedback from our current staff, has led to deep introspection at Colorado Public Radio. These are hard lessons about the harmful effects of white privilege and implicit bias.
Read the full statement from our President & CEO.

Celebrate Summerfest!

CPR Classical's 10-week summer festival features a star-studded concert series of today's greatest performers and Colorado's own world-class festivals and musicians. We're providing a front row seat in your own home or your lawn to the best soundtrack for your summer.

B-Side Fridays On Indie 102.3

The B-Side Summer Music Series is going virtual this year. Indie 102.3 has partnered with MCA Denver to bring you the rooftop performances virtually. Watch every Friday at noon on Indie 102.3's Facebook page or listen at 9 p.m. each week.