What do I do

My partner and I separated when I was pregnant. It was his house we were living in and he pretty much told me if I wasn’t happy to leave. So I left, three kids in tow ( not his ) and heavily pregnant with his second, I packed up and left. I worked very hard on moving on with my life and bringing up our child on my own. My parents were very supportive and that’s how I got through. He contacted me before Bub was born and told me how much he missed me and how he wanted to be part of bubs life. I let him back in slowly and he was there for bubs birth. We have tried to work on our relationship since then , it’s been ups and downs. We live in separate houses but not far away from each other ( approx 500m)
I know he has taken back up smoking weed because at night some times he has turned his phone off so I can’t contact him. I’ve turned up without him knowing , and he has been absolutely smashed. This is a problem and he knows how I feel about it.
I know with the whole weed smoking his libido drops, but is it not normal to not want sex at all? I know he’s watching porn and getting himself off because he just doesn’t purse it with me. We spent a night together recently and nothing was initiated by him, he didn’t even come to bed when I did. I’m struggling with initiating it myself because of the rejection I felt while I was pregnant. I know he’s not with anyone else. I don’t know what to do. I feel so hurt and rejected. Why would he rather do that than make love to me. I’ve spoken to him and he always has excuses. He knows how i feel. Do I just end it and get on with life?