Physio for fractured fibula

Hi,
I have fractured my fibula playing soccer and the location it was broken at wasnt really low colse to ankle but bit higher and was a transverse fracture. I was undergone a screening pocedure i believe called II under General Anesthetic to findout if i needed internal fixation surgery with screws as my ankle was swollen with bit pain after a week of fracture.
Luckily they didn't find the need to do surgery and i was given a boot and crutches to use. I used them both until yesterday . Yesterday i went to the doc and he made me stand on it and there was no more swelling and he said not to wear the boot anymore and start walkin on it with some basic strenghtening exercise.

Today after some walking at home i am noticing a small swelling at lateral side of lower leg on ankle and some pain on the heel bone when i walk.

Should i be worried that i had no swelling yesterday but got it today or is it because of the pressure of walking on it after a while ? or should i seek medical advise? or try any particular physiotherapy ?

Thank you