The former Bank of England governor insists the time has come to move on from Brexit and focus on the future, which may not be too bright.