A proposed 100-foot building next door to the museum -- where a secret Underground Railroad passageway was discovered recently -- would cause irreparable damage to the historic landmark, experts say.