Hi anewsanta,
Wow - I have the exact same problem. I used to be a big wine lover. Now I can't bring myself to drinking a single glass.
I think my fear started when I tried some pot last year (bad idea.) I wanted to try it because I heard it can help some people with anxiety attacks. Well, I guess I had too much, and everything became fuzzy. I started to hyperventilate and had a bad panic attack. I couldn't control my breathing because I was having trouble counting to 10. The worse part was that the effects lasted for over 6 hours.
Ever since then, I can't bring myself to drinking any alcohol, or taking any drug that can alter my state of mind (painkillers, anaesthetic, etc.) This is devastating to me, as I think I will need surgery very soon for my wisdom teeth!
My advice to you, try drinking a half a glass of wine today. It takes 1 hour to metabolize one drink, so if you panic, you can expect it to last only a half hour.