Benzos are weird. I suppose science and empirical data would say no. I think that you could have a flashback type experience maybe, like a flashback to the feeling in general of being on benzodiazepines could bring back harsh memories of what the withdrawals are like. I don't think that a one time use could precipitate complete wd's though, that wouldn't really make sense.
What was your dose of valium while you were on it? Tapers are obviously necessary to avoid unpleasant and dangerous consequences of benzo wd's, but they probably won't completely solve your problem, it's still not fun... but you know that. I think if you are experiencing these bad feelings again though it's mostly psychological, a "one off" as you said probably isn't a big deal. Feel free to correct me anyone who knows more.