Khums and Sakat are obligatory on the owner himself / herself. Your are responsible to pay your Khums and Zakat from your own wealth. If you and your spouse have joined ownership, then both should agree that any of them to pay their dues. Both should have the intention (Niyyah) of paying their dues religious due for the sake of Allah (SWT).
Wassalam.