Kelsey Grammer & Wife Kayte Welcome Daughter

Kelsey Grammer and Kayte Walsh attend the 65th Annual Tony Awards at the Beacon Theatre in New York City on June 12, 2011 -- WireImage

Kelsey Grammer and wife Kayte are the proud parents of a newborn baby girl.

"Early this morning Kayte gave birth to Faith Evangeline Elisa Grammer," Kelsey and Kayte said in a joint statement to Access Hollywood on Friday. "We are thrilled."

PLAY IT NOW: 2012 Golden Globes Backstage: Kelsey Grammer Talks Wife Kayte Expecting Twins

Faith weighed in at 6 lbs., 2 oz., the couple added.

"Mother and child are in excellent health," the statement said.

VIEW THE PHOTOS: Hollywood Dads & Their Adorable Little Ones!

The joyous news was bittersweet, as the couple revealed that Kayte - who they had previously announced was carrying twins -- lost one of the children during her pregnancy.

"We were ecstatic earlier this year, when we announced that Kayte was carrying twins. Tragically we lost the little boy shortly thereafter. This was not something we cared to make known publicly at the time. It was unspeakably painful and we know that people will understand our desire to keep the news private then, as we know they will respect our privacy in this matter now," the statement explained. "A glorious birth with a lingering sadness is ours today. We choose to celebrate the life that has been given us. We proudly introduce our Faith to the world today looking forward to the days ahead and the children yet to come."

Faith is the first child born to the couple, who tied the knot in February 2011, before renewing their vows in June 2012 in Las Vegas.

VIEW THE PHOTOS: Hollywood’s Hottest Moms & Their Loveable Little Ones

Kayte, 32, previously suffered another miscarriage in 2010.

Kelsey, 57 - who recently wrapped production on the second season of the Starz TV series "Boss" - has four children from previous relationships.

VIEW THE PHOTOS: Celebrity Baby Bumps

-- Eric Anderson

Copyright 2012 by NBC Universal, Inc. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.