Climb up through the old well to enter the castle.

Verified marker on the map.