HELP!! Advice on Taper

It’s been almost 3 weeks since I have used any sort of steroids but today I had to go to the emergency room due to my skin, looking like a tomato, as well as inflamed and overbearing. I took 50 mg of prednisone. And the doctor suggested I do a seven day taper of it. I’m really scared because I feel like if I go on and actually do the taper I’m going to end up worse after those seven days. Should I do it or should I just take this one day of relief and go back to my steroid free journey.