Unwanted pregnancy.

I recently found out I am pregnant to a man that I am not "officially" in a relationship with. I have a child to a previous marriage which ended when my son was 2 months old and it broke my heart realising that I brought a child into this world without having a proper family. I don't want to do that to another child, however the guy is saying he wants me to keep the baby and we will be together. I don't want to be with someone BECAUSE we have a child together. It's too much of a risk. My question is.. Does he have any legal grounds to stand on to stop or delay me having an abortion??