You might know he loves you, but you are dead wrong. He is using you to ease the pain of being rejected by someone else.
He don't love you.
Dump him and run. The longer you care for him and let him use you, the greater will be your hurt when he finds someone he wants to see and be with. He is killing time with you, until someone "better" comes along.
Not only does he not love you, he doesn't even care about you as a friend. He is a loser and a user. He needs to be dead to you.
If you have no self respect, others will not respect you.