It refers to the desert Arabs (the Bedouins); one way this is clear is that it is referring to them as "them" rather than "us".
Keeping in mind, also, that what is conceived of as "the Arab world" today did not exist back then since most of the Middle East did not become culturally or linguistically Arab until the expansion of the Arab-Muslim state after the time of the Prophet (S).