push one's buttons

annoy bother exasperate get in one's hair infuriate irk irritate madden needle pester provoke rattle one's cage rile ruffle upset vex