depends on your tolerance to the drugs you mentioned, if what you're on right now is normal for you than adding an Ambien will not hurt you at all, it might not even put you to sleep.
However, if you're new to opiates or don't take them often I'd play it safe and not take the ambien.