Two hundred people remain in four towers in North London that should be abandoned over fire safety fears.