Funky remote function

My remote for Uverse TV doesn't work properly.  I often have to press key repeatedly before it responds, and it seems to be way too sensitive to being aimed exactly.  Yes, I have replaced the battery.  What might be wrong?