‘I will be leaving with my head held high,’ says UK premier