The Portsmouth Shipyard Naval Museum (link) is located at 2 High Street in Portsmouth. Check the website for hours of operation. The museum has a number of interesting artifacts includind a piece or iron plating from the CSS Virginia.
Portsmouth Naval Shipyard Museum- Interior Part 1