CityTour.net

Hidden · Governors Island, New York City, United States

Castle Williams

A round red sandstone fort in New York Harbor that went from guarding the city to holding prisoners, and is now left to visitors who take the ferry.

Built1807–1811
WhereGovernors Island
DesignerJ. Williams
Managed byNPSsince 2003
Castle Williams on Governors Island, a circular red sandstone fort
Photo: Jim.henderson, public domain, via Wikimedia Commons.
The place

A fort built to stop ships, with walls up to eight feet thick.

Castle Williams sits on the northwest point of Governors Island, a few minutes by ferry from the southern tip of Manhattan. It is a nearly circular fort of red sandstone, about 40 feet high and 210 feet across, with walls 7 to 8 feet thick.

It was designed and built between 1807 and 1811 under Jonathan Williams, chief engineer of the Army Corps of Engineers, as one piece of the harbor defenses that also included Fort Jay on the same island and Castle Clinton at the tip of Manhattan.

The idea was to stack guns in enclosed rooms called casemates on several levels, so a small fort could put a lot of fire on the water. The design was copied along the American coast for most of the 1800s.

What happened here

From harbor fort to military prison.

During the Civil War the castle housed newly recruited Union soldiers and also held Confederate enlisted men and Union deserters. By the 1880s its walls were pitted and the fort was considered obsolete as a defense.

It then settled into a second life as a military prison. It was fitted as a model prison in 1903, became part of the Army disciplinary barracks system in 1915 and 1921, and was rebuilt inside in the 1930s and 1940s with steel cells and concrete balconies in the courtyard. The Army closed it as a prison in 1965.

The Coast Guard arrived the next year and first thought of tearing it down. Instead the castle served as a community center and later as storage until the Coast Guard left the island in 1997. In 2003 Castle Williams and Fort Jay passed to the National Park Service as part of Governors Island National Monument. The building is listed on the National Register of Historic Places.

Photos

The castle and its harbor.

Cyclists riding past Castle Williams on Governors Island
Cyclists riding past Castle Williams on Governors Island. NPS, public domain.
Bay and harbor seen from near the castle, an early view
Bay and harbor seen from near the castle, an early view. The Metropolitan Museum of Art, CC0.
Aerial photograph of Lower Manhattan, with Governors Island just off its tip
Aerial photograph of Lower Manhattan, with Governors Island just off its tip. U.S. National Archives, public domain.
Governors Island in an 1825 view of New York from the Hudson River Port Folio
Governors Island in an 1825 view of New York from the Hudson River Port Folio. Public domain, via Wikimedia Commons.
A building next to Castle Williams on Governors Island
A building next to Castle Williams on Governors Island. Otávio Astor Vaz Costa, CC0.
Go and see it

Practical notes.

Castle Williams is on Governors Island, which you reach by ferry from Manhattan or Brooklyn. Ferry times change by season. Tours and activities near Castle Williams.
The National Park Service runs the castle with Fort Jay. Opening days and interior access vary, so check the NPS page first.
The outer walls and the harbor views are worth the trip even when the interior is closed.
Pair it with Fort Jay, a short walk away, to see both halves of the island’s defenses.
Tours that pass the harbor forts

Worth a look.

Statue of Liberty, Ellis Island, and 9/11 Memorial Guided Tour

Statue of Liberty, Ellis Island, and 9/11 Memorial Guided Tour

4.0 ★ · 532 reviews · 5 h

Passes the harbor forts
$79.99per personSee this experience
Brooklyn Bridge, Statue of Liberty and Manhattan Tour

Brooklyn Bridge, Statue of Liberty and Manhattan Tour

4.0 ★ · 24 reviews · 5 h

Passes the harbor forts
$50.00per personSee this experience

Sold by Viator. Prices and review counts checked on 09/09/2026. These tours cover the harbor; they do not land on Governors Island.

Questions people ask

Before you go.

Can you go inside Castle Williams?

Access depends on the season and on the National Park Service, which manages the castle together with Fort Jay. Check the NPS Governors Island page for current hours before you go.

Why is Castle Williams round?

Its circular plan let guns on four levels cover the water in every direction, and it became a model for American coastal forts through the 19th century.

Was Castle Williams ever a prison?

Yes. It held Confederate soldiers and Union deserters during the Civil War and served as an Army prison from the late 19th century until 1965.

How do you get to Governors Island?

By ferry from Manhattan or Brooklyn. Ferry schedules change by season, so check the Trust for Governors Island before planning the day.

More to see

Around New York City

More things to do around here

Walking tours, day trips and experiences around this area, on GetYourGuide.

Tours and activities ↗
Affiliate disclosure. If you book through the links on this page we may earn a commission from Viator, GetYourGuide or Expedia, at no extra cost to you. It does not change the price you pay and does not influence what we write.

Written by CityTour editorial. Sold by Viator.