Straight Brandy is something of a dessert. And, *yes*, it is an acquired taste. You may find that you have been exposed to some craptacular brandy.... in which case, wait a few years, loose the experience, then try it again.
Brandy/Cognac types of liquors are something to be savored... not...