Red Hot Mama! Pregnant Jessie James Decker Walks the Red Carpet at the 51st Annual CMA Awards

Jessie James Decker is one dazzling mama-to-be.

On Wednesday night, the pregnant 29-year-old country-pop star stepped out to attend the 51st Annual CMA Awards in style, looking stunning in an off-the-shoulder cranberry-colored dress by Nookie that showed off her growing baby bump.

“They keep getting easier and easier. The first one was really brutal,” Jessie told PEOPLE during the event of her pregnancies. “[Daughter Vivianne “Vivi” Rose, 3½] tried to kill me. The second one [son Eric “Bubby” Thomas II, 2] was pretty tough, and this time … If I’m tired, it’s because I’m running after two little ones.”

“But I’m fine,” added Jessie, who is expecting her and husband Eric Decker‘s couple’s third child: a baby boy, due in late March. “Sometimes I don’t feel that pregnant even though you can tell that I am. I’ve got a ways to go.”

Want all the latest pregnancy and birth announcements, plus celebrity mom blogs? Click here to get those and more in the PEOPLE Babies newsletter.

Jessie tells PEOPLE her kids are “so excited” about their little brother on the way. “Vivian pulls up my shirt every day and kisses my belly,” she shares. “My son’s not really that aware. She’s 3½, so she knows. It’s amazing.”

The nursery is ready to go, too — and as the third-time mom-to-be shares, a lot of “hand-me-downs” were involved in making that a reality so far ahead of her son’s arrival.

“My son, who is 2 now, is transitioning into a toddler bed, so we just kind of moved all his baby stuff into the other room because we had to get my son, already, a brand-new toddler bedroom set,” she explains. “So it just kind of worked out.”

And what about the balance of parenthood and her career? “[With] each baby, I have more success in my life,” Jessie says. “I put out an album two weeks ago and I have zero radio play and a No. 1 album on Billboard, so for me it’s a blessing and it makes me want to work harder and make my children proud.”

Although Jessie and her Tennessee Titans wide receiver husband are already parents of two, the singer doesn’t seem too concerned about making the jump from a family of four to five. As she tells PEOPLE of Eric, “He loves to keep making babies.”

When talking to Mini magazine earlier this month, the singer explained that she thinks the hardest part of expanding her family is already behind her. “I have heard that one to two is the biggest hurdle,” she explained. “I’m not too worried about it.”

According to Jessie, a third baby was always in the cards for her and Eric. “I think we’ve always felt like we wanted three children,” Jessie told PEOPLE back in August. “I came from a family of three kids.”

“[For Eric], it was just him and his sister, and he said he always felt like they were missing a sibling and he wishes [his parents] would have had three,” she continued. “So I just didn’t want Vivi or Bubby to feel like they wish they had another sibling.”

The 51st CMA Awards will be held at Bridgestone Arena in Nashville on Nov. 8 at 8 p.m. ET. The show will air live on ABC.

• Reporting by NANCY KRUH