Ex-President Ulysses S. Grant purchased the residence in Manhattan's finest quarters. Grant's wife, Julia Grant, spent the greater part of the winter there while her husband was traveling. The building is no longer in existence.