"That they went far from me" (Jeremiah 2:5). Rabbi Pinhas said in the name of Rabbi Hoshaya: they would drive away those who sought to return [repent], as it is said, "and I drove him from me" (Nehemiah 13:28).
They Went Far From Me and Those Who Drove Off the Returning
Pesikta DeRav Kahana 14:6
[ו] כי רחקו מעלי (ירמיה ב:ה). אמ' ר' פנחס בשם ר' הושעיה שהיו מבריחים את השבים, כמה דאת אמ' ואבריחהו מעלי (נחמיה יג:כח).