It sounds to me like he's playing you off. Or is the most tired guy on the planet. If I were you, I'd confront him about what's really going on? For two weekends he's managed to not make time for you because he was sleeping. Nobody would believe that.
So there has to be something else up. And you need to understand what is really going on.
But from where I'm standing, it looks like he just doesn't feel like being bothered with you and is making that pretty clear.