Former foreign secretary Boris Johnson told a packed fringe event at the Conservative Party Conference that now is the time to 'chuck Chequers'.