UK government officials said they had "lost confidence" in the outgoing chief constable as a result of the scandal.