The burning is inflammation.
I have scoliosis, but the curve is minor. If you have never done body work to correct your posture, then I suggest starting with massage therapy and chiropractic. While you see them, start going to the gym to do muscle strengthening in your back. If you don't know what to do, then consult a personal trainer for a couple of hours. Learn about stretching... you don't necessarily need to do yoga, but learn a series of stretches for your back but also everywhere else. Everything feeds into the back, especially the pelvis. So if your legs are tight, then your pelvis is tight, and then your back will be tight. I have found that the worst thing for my posture is sitting in chairs for a long time. When we sit in chairs, our pelvis tilts forward, which shortens the hamstrings (on the back of the legs) and lengthens the quads (on the front). Then when we stand up, our pelvis is stuck tiling forward, and our whole upper back tilts forward because of it.
So I have found that if I don't have time to do anything, the very, very basic thing I'll do is hamstring stretches and quad stretches.
Last year I started taking ballet classes because I always wanted to. It has been the best thing for my posture ever. My teacher recommended that in order to get functional posture alignment, flexibility, and strength that I should start doing pilates. I really hate exercises classes but I tried it, and now I can stand up straight naturally without having to try. Weight lifting never
corrected posture on its own because it's static movement. You really need dynamic movement to get everything strong in a moveable way.
The spine needs a combination of flexibility and strength in the right places in order to stand up straight, but if you have scar tissue or injury that's causing your back to hunch then you should get some kind of therapy to start with. My journey started with a really awesome chiropractor. He fixed 80% of the problem, and I have been doing my own work to get the rest of the way.