You might have a difficult time finding a hot sauce that doesn't use vinegar as a carrier for the peppers. You'll find sauces that have other ingredients, such as sugar, garlic, mustard, etc., but the vinegar is there.
If you want to avoid the vinegar for things like soup, you should simply learn how to season soup with peppers themselves. Maybe experiment with homemade pepper pastes.
I suppose if you look around, you could find commercial pepper pastes as well.
Have a look for
gochujang or
curry paste, for example.