Another interpretation: To a king who had a household steward and gave him authority over all that he owned. Everyone began to say: he is the king's partner. What did the king do? He drove him out. So too, "And the LORD sent him out from the Garden of Eden" (Genesis 3:23).
The Steward Trusted With Everything and Then Driven Out
Yalkut Shimoni on Torah 34:5
דָּבָר אַחֵר, לְמֶלֶךְ שֶׁהָיָה לוֹ בֶּן בַּיִת וְהִשְׁלִיטוֹ עַל כָּל אֲשֶׁר לוֹ, הִתְחִילוּ הַכֹּל אוֹמְרִים שֻׁתָּפוּ הוּא, מֶה עָשָׂה הַמֶּלֶךְ טְרָדוֹ, כָּךְ וַיְשַׁלְּחֵהוּ ה' מִגַּן עֵדֶן.