Theresa May has issued a formal apology during a meeting with Caribbean leaders inside Downing Street.