Former Tottenham midfielder Adel Taarabt had fired the hosts into the lead on 22 minutes with his first Premier League goal.
Arsenal levelled through Theo Walcott 15 minutes later, but Rangers snatched what could prove a priceless victory through Samba Diakite midway through the second half.
Source: PA
Source: PA