Did you recently installed any app? Or do you see any notifications when phone vibrates? Otherwise, if it won't stop, I highly suggest that you keep your phone off and bring it to a service center. Looks like a hardware issue that needs to fixed ASAP.