Former Swansea player Leighton James believes the club's failure to replace key players is the cause of their poor start to the Premier League.