When i started having sex i hated the things. Then again, I was using the government issue condom at the time, which is more inclinated towards safety than pleasure. This helped in the sense that it re-sensitized my quite de-sensitized penis - apparently frequent masturbation can do that
Since i started using FeatherLights and other "better" condoms, sex has become a lot more pleasurable for both me and my SO. Also, try some positions that provide more friction for both of you.