Yes if you are prone to anxious feelings, you might well feel panicky during the come up period.
Things you can do to keep these under control include taking the drug in a place where you feel safe and secure with just one or two other people who you trust. It's always advisable to take only half a pill/dose the first time to see how it affects you. After it kicks in and you start to feel good, you can safely take the other half.
I usually have a period in which I feel cold during the come-up and I like to be somewhere nice and warm.