When Moses saw the camp dancing around the calf, the Torah says he saw that "the people were naked." What kind of nakedness? Targum Pseudo-Jonathan, the Aramaic paraphrase of the Torah, reveals the loss.
At Sinai, every Israelite had received a holy crown. Upon that crown was inscribed the great and glorious Name of God. The people had worn it not as decoration but as a covenant. When Aaron bent to the will of the mob, those crowns were stripped from every head (Exodus 32:25). The camp stood suddenly bareheaded before their God, and worse, bareheaded before history.
The Targum adds a second, sharper loss. "Their evil report would go forth among the nations of the earth, and they would get to them an evil name unto their generations." The shame of the calf would outrun any apology. The nations would speak of this moment long after the gold had been scattered on the stream.
This is why Moses is so devastated. He does not only see a ritual violation. He sees a people who removed the Name of God from their foreheads and handed the gentiles a story to tell forever.
Takeaway: What we lose in a moment of collective failure is rarely only the immediate thing. It is the crown we did not know we were wearing, and the testimony we leave for generations.