No, but there are clearly herbal medicines that are not mild, and some that are not safe in certain situations; for instance,
FDA/CFSAN Consumer Advisory: Kava-Containing Dietary Supplements May be Associated With Severe Liver Injury.
You can't automatically say "herbal=safe". You might be able to say "Valerian root=safe", I have no idea.