The building was embellished in 1902–1903 with a triple French Romanesque Revival portal by Stanford White. This stone relief above the entrance to the church depicts a number of Biblical scenes. On the frieze between the doors, New Testament stories are shown: Kings from the East arrive, next is the flight into Egypt, and finally, the betrayal of Jesus and John the Baptist. Old Testament figures--Isaiah and Elijah--are shown in the niches.