I have the same experience. Even if the TV seems to be tuned to an "ads-only" channel, or some sporting event that holds utterly no interest to me, it captures my attention repeatedly.
It's like the visual equivalent of a mosquito buzzing by my ear; not at all desirable, but extremely difficult to tune out.