Two months is long enough for it to cause some issued upon discontinuation. I have never taken this medication, but my rule of thumb is that whatever it is used to treat, will feel worse when you stop taking it. Pretty basic, I know. Even if it does not directly cause you to be unstable, you will still be going from having a mood stabilizer in you, to not having one, so keep that in mind.
The main concern, IMO, is that since it is also used as an anticonvulsant, it may cause seizures when coming off of it. I was prescribed lamictal, which also works on sodium channels and GABA, and I know that the lamictal could cause seizures if you abruptly stop it, so one may assume that depakote may do the same. I really don't know though, but you should really taper down to play it safe.