Why did Benjamin merit the reposing of the Shechinah in his portion? This may be compared to (the situation of) a king, who visited his sons from time to time. Each one said let him stay with me. The youngest said: Is it possible that father will leave my big brothers and stay with me? — whereupon he was completely crestfallen. His father, seeing him in this state, said: I will eat by you and sleep by him. Thus, the Holy One Blessed be He said: The Temple will be in the portion of Benjamin, and sacrifices offered by all of the tribes.
Divine Presence of Benjamin
Sifrei Devarim 352:14