Alan Pardew says Chris Brunt was not the only person voicing criticism inside the West Brom dressing room - but he will not walk away from the club.