It sounds like to me that you need a much more precise diagnosis and precise exercise programme to address this issue. This problem is something that physio should be able to fix with correct diagnosis.

In my experience should exercises need to be correctly prescribed and performed correctly and very consistently to make the best improvement. Were you shown scapulae stabilizations exercises? Did anyone massage and stretch your shoulder external rotators. Did you always exercise without pain? Did the physio assess comprehensively at your neck. Did anyone analyse your bodyweight routine. If the answer is no to any of these questions then not everything has been done yet.