Do I need antibiotics or over the counter meds?

I have had a headache (all over - not just one area) for 4 months, ear ache for 2 months. My doctor has put me on claritan and a decongestant in the beginning and then about 3 weeks ago put me on Allegra. Initially it took the edge off of my headaches but now my cheeks and ears are aching all the time. I don't have a runny nose and no cold symptoms. So I believe what I have is a sinus infection. Since it has gone on for awhile do I need antibiotics or can I just buy Tylenol Sinus or something like it.