Fascinating question....I think I see TIO's explanation now!!
and now I think i agree.
The fact that you're on the 4th floor on the building is what matters, isn't it?? If you were on the middle floor, I think it would be 50/50, but since you're above the mid-point it does indeed sound like it makes a difference. For example, if you're on the top (5th) floor, there's zero chance that it's going up....