And thus do you find with the men of the tower (of Bavel) that with what they vaunted themselves before Him, He exacted punishment of them. As it is written (Genesis 11:4) "And they said: Let us build for ourselves a city and a tower with its top in the heavens, and let us make a name for ourselves lest we be scattered, etc." (Ibid. 6-8) "And the L–rd said … Let us go down, etc…. And the L–rd scattered them from there, etc."
God Looked at Their Project and Responded Let Us Go Down
Mekhilta Tractate Shirah 2:6