Kristin Cavallari on Fitting in Date Nights with Jay Cutler: 'We Have to Work on It Like Everyone Else'

Paul Archuleta/FilmMagic

Kristin Cavallari and her husband, Chicago Bears quarterback Jay Cutler, certainly have their hands full between flourishing careers and being parents to three kids.

But the twosome still make sure to find time for just each other, even though doing so isn’t a simple task.

“It’s hard because by the time they all go to bed at night we are so exhausted,” the former Laguna Beach cast member told PEOPLE on Saturday at the Carousel of Hope Ball in Beverly Hills, California.

“We try to make date night regular, but it doesn’t happen as often as we would like, especially now that he’s in the football season, so he’s really busy,” says Cavallari, 29, adding candidly, “I wish I had some secret I could tell you. I don’t. We have to work on it like everyone else.”

Want all the latest pregnancy and birth announcements, plus celebrity mom blogs? Click here to get those and more in the PEOPLE Babies newsletter.

Considering fitting time in for just the couple can be tricky, it’s probably a good thing Cavallari’s opinion of a perfect date night isn’t too intricate.

“Go to dinner,” she says when asked what the ritual consists of. “Then I’m like, ‘Okay, I have to be in bed by 10.’ If we can have a glass of wine and actually talk for five minutes, that’s ideal.”

Cavallari and Cutler, 33, are parents to daughter Saylor James, 10 months, and sons Jaxon Wyatt, 2, and Camden Jack, 4. The model and author shares that each of her children are currently hitting exciting milestones — along with some challenges too.

“Camdens in school five days a week now, and he loves it. Which makes me kind of sad because he’s my baby,” she admits. “He’s really coming into his own. He has a very strong personality and he was so shy as a baby, so that’s been really cool to see.”

“Jaxon, my middle child, is just trying to learn how to ride a bike right now,” the busy mom says. “He’s in school a couple of days a week.”

Cavallari says “Terrible Twos” were more like “Terrible Threes” with Camden, but that her younger son is her “tough cookie.”

“[Jaxon] is the one that never sits still, will throw a tantrum over nothing, and literally you can’t stop him until he just has to work it out of his system. There is nothing you can do,” she explains. “He’s my typical boy, climbing on everything. Just doesn’t stop.”

“Where Camden, my oldest, is really mellow for a boy, which is a shock,” Cavallari continues.

Fortunately for the health-conscious former reality star, it’s been smooth sailing with her third (and last) child.

“Saylor, my daughter, is just the easiest, best baby on the planet,” she says. “I don’t know how we got this lucky. Put her down, she is content the rest of the day. She hasn’t made a peep since the night before I was going to sleep train her. She slept through the night on her own.”

The mom of three admits Saylor didn’t get that mellow behavior from her, though.

“I was the worst baby too, so I don’t know,” Cavallari says. “[Saylor] goes to bed at 7 p.m. and wakes up [at] 8:45 or 9. She takes two naps. Jaxon was tough, though, we paid our dues with him.”

— Jen Juneau with reporting by Raha Lewis