There ae different opinions among the scholars in this matter.
Al Haafidh Abu Na'eem sated in Hilyat Al-Awliyaa that Ima Al-Ridha had six sons and Jafar is one of them.
Mohammad Ibn Talha al-Shafi'ee had the same opinion.
Many of our scholars including Shaikh Al-Mufeed and Al-Erbily narrated from Imam Radha (AS) that he wl have only one son (Imam Al-Jawad) and Allah (SWT) will grant this one son lot of sons.
Wassalam