Sacked de facto deputy prime minister Damian Green refuses to comment as he leaves his house in Acton on Thursday morning.