The 61-year-old actor and his wife confirmed the birth on Monday (November 14).
“The name was chosen to honor the great poet W.H. Auden, and James is after another great poet and singer James Taylor — two of our favorites,” the couple told People in a statement.
Kelsey has children from previous relationships including Spencer, 33, Greer, 24, Mason Olivia, 15, and Jude Gordon, 12. Kelsey and Kate have two other children Kelsey Gabriel Elias, 2, and Faith Evangeline Elisa, 4.