This symbol usually shows up on a phone if there is unread e-mail. If you don't have any unread e-mail, try rebooting your phone to see if that will make the symbol disappear.