I wouldn't suspect a genital wart. I have personally seen HPV on a male in the beginning, middle and final stages. It begins and ends with a formation that looks similar to a skin colored tag mole in shape and size. It's generally somewhat more firm and dry than a tag mole is though and it usually flakes off. It begins though like a very small tag mole, not like a small vesicle as these appear.
Here is a photo of genital warts.
If anything I would suspect jock itch, though you may not be itching it could still be in it's early stages and is not necessarily itchy to begin with. Now ringworm, athletes foot, jock itch, yeast infection, foot fungus are all a different location of the same fungal infection. They are easily treated by over the counter creams such as clortrimazole. There are usually small white flat 'pimples' that eventually pop leaving tiny dips in the skin where the vesicle once was. It is when they pop and spread their clear fluid that they spread their fungal spores. Washing frequently, using a corn starch power such as Mexana instead of a talc powder, and changing your underware frequently and especially after exercise or working out should all help. If it is an allergic reaction or just some minor dermatitis those precautions should show some results.
IF the bumps change, grow larger, or you have any other uncomfortable symptoms I would go promptly to a Dr. Even if it is something minor such as jock itch and you go then the worst case scenario is that they can give you a more effective prescription cream for ridding yourself of it more quickly.