Hahaha, of course! If the cap fits...
Nah, I think you get away with it. If it were me, certain less sympathetic / more humourless types might imagine lots of chin-stroking and po-faced pseudo-intellectualism, and the fact is I very rarely, if ever, stroke my chin.