Former justice minister Phillip Lee , who quit earlier this week over the government's policy for leaving the EU, claims Theresa May could lose more members of her government.