I think there are several levels at which tolerance might develop, as the SERMs action on test production is indirect, blocking the binding of E2 at the ER in the hypothalamus, which in turn releases GNRH that will signal the pituitary gland to produce more LH that will signal the Leydig cells in the testicles to produce T.
Which of these steps will see a decreased response first?