Oh Jess, I would definitely bring BOTH passports with me... see, this is my spy tactic.
Just kidding. No, I generally exit and enter the country using my US passport to make things easier, but when traveling in other countries, the Icelandic one is just safer in general and makes things faster (esp. in the EU). Thanks, though!