I would suggest strengthening your core, this effectively takes the pressure from off your spine. Try researching training the transversus abdominus and multifidus muscles. These are core stabilisers and require precision to activate. But done correctly this should alleviate your problem.

Also you might try to see someone who focuses on postural analysis as your symptoms make me think you might have an excessive lumbar lordosis.

Hope this helps.