Without X-rays, it is difficult to answer this question because it is individual. This is influenced by the factors of your regeneration and care for your hand. If you have aggravated the situation, then you do not tend to recovery as you say.
Be careful and do not expose yourself to injury, for a week or two, consult a doctor with this issue. I am sure he will be able to answer the exact question. I do not recommend giving loads even after removing the plaster, because the muscles will be partially refined and you need to restore mobility.