drive up the wall; go on someone's nerves

to drive someone to a state of insanity or extreme mental agitation