Become his friend, and see if you still like him. Being his friend first is always the way to start a relationship. Look at people who are dating. People who were friends first usually have the longest relationships, while alto of people who start going out right away date for a week, max. So just become his friend, and stop rubbing his arm out of nowhere! Lol

Good luck!