For people on Vytorin, memory loss appears to happen infrequently. However, talk with your healthcare provider or pharmacist if you have concerns about this. Also, keep in mind that it is not possible for your healthcare provider to know beforehand whether you will have a side effect with a medicine that you have never taken before. If you notice any memory loss while taking Vytorin, talk to your healthcare provider. He or she may recommend adjusting the Vytorin dosage or switching to another cholesterol medication.