Toprol-XL and time doctors

Have been on Toprol 25 mg for almost a year, and prior to that was at 50mg for about two years, prescribed for fast heart rate/benign palpitations and also for boderline high BP. Worked fine for BP and palpitations, but six months ago, BP went high again, so now on Diovan low dose and still Toprol 25 mg. Anyway, Diovan has fixed the BP. The most major side effect with TOPROL I believe is the cause for my shortness of breath. I have now began weaning myself off of the Toprol (with ok from Cardiologist) and hope to see an improvement with the SOB....it's been terrible. I get short of breath just talking on the phone, and I do not smoke. I'm hopeful that the symptoms will improve one my body is clear of the Toprol. Anybody else experience SOB from Toprol?