Rashi and Seforno: It refers to guarding the Mishkan,
1
the onus of which lay on the shoulders of Aharon,
2
and whom the Levi'im were now appointed to assist, to make sure that no Zar enters.
3
Rashi: As the Torah writes in 18:1. The Seforno adds that they were also appointed to assist Aharon and his sons, on whom lay the onus of guarding the Kehunah, to make sure that no Zar usurps it.
Ramban (in his introduction to Bamidbar, DH 'v'Hinei', citing Sifri Zuta): One cannot compare the palace of a king, which has guards, to a palace that does not.
1