The club was organized October 16, 1866 for “the purpose of fostering wholesome sport, recreation, sociability and communal activities,” and incorporated in 1868. Its two story clubhouse was constructed in late 1869 using traditional, river-style ‘tree nails.’ At first, the club was located at the foot of Gold Street in Yonkers. In 1910 it was floated by pontoon to a site known as Dudley’s Grove in Hastings-on-Hudson.
The club lost what little road access it had with the completion of the Metro North Greystone train station. Current access is only by pedestrian footbridge or boat.