Boris Johnson has declined to talk about a row involving his partner saying it is unfair to 'drag' his loved ones into politics.