Lyric discussion by Prevolition 

Annie has a lot of respect for Sufjan, so I doubt this is a direct reference to him.

Recent Reddit AMA:

"Will you ever collaborate with Sufjan again? Cheers for the music, the new album's great. [–]St_Vincent Annie Clark[S] 221 points 1 month ago i love sufjan's music. i played in his band for a couple of tours on "come on feel the illinois(e)?" -- it would give me too much credit to say i "collaborated" with him. he's a beautiful musician."

2009 interview with Flavorwire:

"FP: You call yourself St. Vincent and toured with Sufjan. Sufjan’s known to include some religious subject matter in his work. Do you ever incorporate religion as a theme?

An error occured.