Don't know if that is true of every guy out there, but from the experiences i have had, and the experiences my friends have told me about, then this is very common.
Perhaps you're better off to do this whilst coming down? I have not experienced this for myself (although one day i will, i'm sure,) but i have been told that if you want sex on e, then this is the best way to go about it.
Good luck at any rate...