Easy, don't talk to him.
Look, he's not going to get it. Obviously the guy's got some problems with his life that he needs to work out, and you've decided you can't stick around to deal with that. This is fairly normal, but he's not going to see the problem.
If you have to, get a no-contact order, but pure and simple, you're doing the right thing by walking away.