What the fudge is his problem? :/ Short question?

Either he's intimidated by you, or he's weirded out by you. Either way, back off for a while. Let him come around, and let him initiate the next time you get dirty.