Was he flirting, trying to be funny or just being a jerk?

Are you sure that he knew where he was going? He might have been going the only way he knew.. And that is why he was hesitant to go to beginn with. When he lost you he got really worried...