First off, you have this phenomenon in reverse. You won't get sick by using Opioids while maintained on an Opioid antagonist like Naltrexone; the effects will just be greatly reduced. If you're dependent upon Opioids and then ingest Naltrexone, this will typically provoke a violent and immediate withdrawal syndrome.
To answer your question: you will noticed some muted effects from taking Opioids. If you're looking to get high, I would advise not taking the Naltrexone for a couple of days. However, I don't advocate for giving up progress in sobriety. If you're doing well on the Naltrexone, I would stick with it.