"you shall remove": (even) from a place of cleanliness to a place of uncleanliness.
I might think that this holds for the other years, too; it is, therefore, written "in that year": It applies only in that year, and not in the other years. "in that year": You remove the produce of that year, and not greens that grew from Rosh Hashanah until Pesach, (for Rosh Hashanah begins a new year, so that it is the produce of the fourth year and not of the third.)
"and you shall place it in your gates": And if there is no poor man there, place it in the store-house.