The Labour leader believes he "learnt a lot" from spending time with a "radical" Jewish group despite a backlash.