Isn't your question inherent in R. Chisda's incessant sighing? And what did Ula answer him? He cited R. Yochanan, who referred to a Divine decree, a plague that destroys the houses of Tzadikim, that began with the destruction of the Beis-Hamikdash.

What, do you don't like that answer!

Neither did R. Chisda, it seems, even though Ula did add that all of those houses will one day be reinstated.

So Ula concluded that the Tzadikim would have to suffer along with Hash-m Himself, whose House is destroyed too.

By the way, I don't think that he and his family were wiped out, just his house (similar to the House of Hash-m, to which the Gemara compares it.

be'Virchas Kol Tuv

Eliezer Chrysler.