Former deputy prime minister Lord Heseltine also said it would be 'an abuse of the constitution' to leave the EU without parliamentary approval.