I don't think tramadol releases serotonin, it's action is that of an SSRI, that is, it prevents serotonin from being taken back up by cells to be destroyed or reused. So you have more serotonin molecules in your synapses doin their thing for longer.
To answer your question, though, it will definitely affect your roll. In my experience, taking tramadol and other SSRIs prevented me from rolling at all, even off a few pretty decent pills. And that's the best case scenario! In the worst case scenario, you risk giving yourself serotonin syndrome, which isn't very common but quite unpleasant and even potentially deadly if it does occur.
So definitely DON'T mix the two, I feel lucky that the worst that happened to me was that I didn't roll, the combo could have had much more disastrous effects.
However, since you took the trams wednesday and aren't rolling til friday, you should be okay. The trams will be out of your system by then, especially if you don't take them on a regular basis. They shouldn't impact your roll given that large of a timeframe between the two.