I guess you are right. But why wouldn't he as the father, married or not, have any rights to time/visitation with his child. This seems wrong, there has to be some sort of legal recourse that as the childs father he can fall back on to get time with his son.