It's much eiaser to understand when you put it that way!
It could be a bug in Froyo, if you put your wallpapers to the SD. Try to move all apps back to memory, and it should work correctly.