Yes. Woman can be a martyr in different ways. Mother of Ammar ibn Yaasir was martyred by the disbelievers in Makkah and mother Wahab was martyred in Karbala and any Momina who dies with the love of Ahlul Bayt (AS) will die as a martyr. (Tafseer Al-Zamakhshari , v. 4, Tafseer Al-Raazi) v. 27.
Wassalam.