Did I abandoned my surrogate son?

If everything happened as you say, it seems like you did everything you could do. If he doesn't want to be a part of your life, then you do not have to be part of his.