You never know what you're going to learn on Andy Cohen's "Watch What Happens Live." This time, we find out Ben Affleck had issues with his wife, Jennifer Garner, being friends with her "13 Going On 30" co-star Mark Ruffalo. Find out what the "Avengers" star had to say!

Ruffalo, who is currently promoting flick "Begin Again," was asked if he kept in touch with Garner, who he worked with in 2004.

"We had a great time together, and I think we would," he explained. "But then Ben came on the scene. And that was the end of that."

Cohen quickly made up a question, asking, "I heard he doesn't allow her to have male friends?"

Ruffalo shrugged, stating he could not confirm nor deny that was true. His co-star Kiera Knightley appeared awkward on the side, clearly feeling for the actor.

We've been hearing a lot lately from Garner and Affleck, but not in a good way. The 41-year old actor was recently kicked out of two casinos.

The first incident took place in May at the Hard Rock Resort and Casino in Las Vegas. A security alert obtained by Radar Online notes "Affleck uses perfect basic, a common term for introductory card counting, according to the alert, but also takes insurance according to the count. Uses black $100 cheques to keep track of the count while playing."

"He has been observed playing blackjack at multiple Las Vegas Strip properties, and is suspected of moving his wagers with the count," the report notes. "He was reportedly backed off at one off-Strip casino."

The second time was earlier this month at the Caesar Windsor Hotel and Casino in Ontario.

"Ben walked in and went straight to the card games," a source told Star. "His hair was a disaster, and he looked like a mess!"

"He sat down and played for roughly 20 minutes before security heard he was there. They made the dealers stop what they were doing and asked him to leave. Ben seemed pretty mad."

Another insider explained, "It took me a minute to realize it was Ben Affleck. He looked disheveled and upset while sitting there gambling."

"He seemed really frazzled like he had just lost a ton of money. He was smoking a cigarette and his head was down in his arms. When he sat up his eyes looked bloodshot, like he'd been there all night!"

Garner was said to have issues with the gambling, but continues to stand by her man.

''She never understood his gambling obsession and she doesn't want him to be in the news [for it], [but] she's the most patient wife ever and is still very much in love with Ben," a source told PEOPLE.

Do you think Affleck stopped Ruffalo and Garner from being friends? Let us know.