I think that the simplest explanation is that Hash-m wanted Dovid to have an atonement or test through the fact that people still suspected him of not being forgiven for this sin, and looked down on him because of this. However, if you would like a different answer, see the Ben Yehoyada on our Gemara who discusses this at length.

All the best,

Yaakov Montrose