The structure narrowly escaped the wrecking ball in the 1960s, when a significant portion of Cape May’s historically Black community was demolished as part of an urban renewal effort.