The central problem with steadfast Brexiteers; they have no leg to stand on