Kris and Bruce Jenner Split: Exclusive Details on His 'Breaking Point'

Beck Starr/FilmMagic

Update: In June 2015, Caitlyn Jenner came out as a transgender woman. This content was written in October 2013 before Jenner publicly announced her full transition.

The more, the merrier: That always seemed to be the Kardashian family’s motto. But this summer, home life became too crowded for Bruce Jenner.

A source tells PEOPLE that the former athlete, who recently announced his split from Kris Jenner after 22 years of marriage, reached a “breaking point” when Kim Kardashian moved into the Jenner household with Kanye West and their infant daughter, North.

“It got crazy,” the insider reveals. “It was all about Kim and North and no one paid Bruce any attention, especially Kris.”

Kardashian, West and their little girl, plus the nannies, moved into an already crowded household: Both Kendall and Kylie still live at home, and daughters Kourtney and Khloé would stop by all the time.

“This was Bruce’s house, too,” says the source. “And he had no room. He felt like he was being shoved into a corner.”

Bruce, 63, and Kris, 57, decided to separate, and the former Olympic athlete moved into his Malibu pad.

“He’s much happier,” the source says. “He loves it there.”

Shortly after news of their separation broke, Kris spoke to PEOPLE and stressed that she and Bruce are “just happier now.”

“We will always be the best of friends, because that’s the dynamic of our relationship … We’re so connected in that way. We love each other,” Kris said.

“People that are best friends and that love each other don’t necessarily have to be married,” she added.

PHOTOS: Keeping Up with the Kardashians’ Love Lives

• Reporting by JENNIFER GARCIA