The graphs show that they will dim, you just need to be careful about it. Make sure you're only varying the voltage through a very low range, and you should be right. Just do the calculations, and bang a (small) rheostat in series with a (possibly smaller) resistor in series with the lights so that the voltage dump across the lights ranges from about 3.4-3.8V, and bob's your father's brother.
__________________
Strewth
|