A baby who weighed just 258 grams when he was born at 24 weeks is finally set to leave the hospital with his parents.