You aren't risking seizures from this dose level. If it was enough to cause it, between me cutting clonazepam out cold turkey and taking Tramadol, I'd have likely had a seizure (though I wasn't taking much Tramadol - it does still lower the seizure threshold).
You say you're getting shaky - how is your blood sugar / pressure? I bet this is more a factor than anything. You have all the info you need on page 1 of this to infer everything for tapering correctly for your situation. I went from ~1.5mg/day (.5-2mg, depending how I was feeling) to 0mg because I just didn't feel like taking them any more (lasted a few days, then family knows best - at least how to best give me a panic attack), and had no real issues aside from slight rebound anxiety (google it if you're still unsure what this means) and insomnia / inability to stay asleep well.