Plus opening and closing the closet will let dust in, so the more it is accessed the more dust will get in.

But still far less than outside the closet.