"And if you make an altar of stones" (Exodus 20:25). Rav Chisda said in the name of Rav: the altar of Shiloh was of stones. This was also taught: Rabbi says, what does Scripture teach by saying "stones"? "Stones," "stones," three times (Deuteronomy 27:5-6) - one for Shiloh, one for Nov and Gibeon, and one for the eternal house [the Temple in Jerusalem]. Rav Achadboi bar Ami objected: the fire that came down in the days of Moses did not depart from upon the bronze altar until Solomon came, and the fire that came down in the days of Solomon did not depart until Menasheh came and removed it. And if it is so [that the altar of Shiloh was of stone], then from the start that fire would have had to depart [when they left the bronze altar]. He stated it like this Tanna, Rabbi Yose, who says: the bronze altar was hollow and filled with stones. Rav Nachman bar Yitzchak said: what does "did not depart" mean? It did not cease entirely. And where was it? The Rabbis say: it would send out its sparks. Rav Pappa said: it lodged as a guest, sometimes here, sometimes there.
The Stone Altars and the Fire That Came Down From Heaven
Yalkut Shimoni on Torah 306:1
(שמות כ כב) וְאִם מִזְבַּח אֲבָנִים, אָמַר רַב חִסְדָּא אָמַר רַב מִזְבֵּחַ שֶׁל שִׁילֹה שֶׁל אֲבָנִים הָיָה. תַּנְיָא נַמִּי הָכִי, רַבִּי אוֹמֵר מַה תַּלְמוּד לוֹמַר אֲבָנִים, (דברים כז, ה) "אֲבָנִים", "אֲבָנִים", שְׁלֹשָׁה פְּעָמִים, אֶחָד שֶׁל שִׁילֹה, וְאֶחָד שֶׁל נוֹב וְגִבְעוֹן, וְאֶחָד שֶׁל בֵּית עוֹלָמִים. מֵתִיב רַב אַחַדְבּוֹי בַּר אַמִי, אֵשׁ שֶׁיָּרְדָה בִּימֵי מֹשֶׁה לֹא נִסְתַּלְקָה מֵעַל גַּבֵּי מִזְבַּח הַנְּחֹשֶׁת עַד שֶׁבָּא שְׁלֹמֹה, וְאֵשׁ שֶׁיָּרְדָה בִּימֵי שְׁלֹמֹה, לֹא נִסְתַּלְקָה עַד שֶׁבָּא מְנַשֶּׁה וְסִלְּקָהּ, וְאִם אִיתָא, מֵעִיקָּרָא הַהוּא דְּאִסְתַּלַּק לָּהּ. הוּא דְּאָמַר כִּי הַאי תַּנָּא רַבִּי יוֹסֵי אוֹמֵר, מִזְבֵּחַ שֶׁל נְחֹשֶׁת חָלוּל וּמָלֵא אֲבָנִים הָיָה. רַב נַחְמָן בַּר יִצְחָק אָמַר, מַאי לֹא נִסְתַּלְקָה, לֹא בָּטְלָה לְגַמְרֵי. וְהֵיכֵי הָוֵי. רַבָּנָן אָמְרֵי דֵּין שְׁבִיבֵי הוּא מְשַׁדְּרָא. רַב פָּפָּא אָמַר, אֻשְׁפִּיזָא הֲוָה נָקְטָא זִמְנִין הָכָא זִמְנִין הָתָם.