That's by design. I believe, from what I've read, that if you go to about
:config and set browser.display.show_image_placeholders to false, you will get the broken image markers. Might have to restart Firefox to get that to work (it doesn't seem to be working for me right now, but I'm also using nightlies). Here's a broken image to test:
The image should be above this line.