Lyric discussion by mojohand 

This song is pretty simple and everyone is over analyzing it.

Kurt was a Pisces, Courtney was a Cancer (astrologically and as a person).

The heart shaped box was a box that Courtney had kept love poems in from Billy Corgan when the two had dated prior to Kurt (she was also a star f***er).

Kurt used to tell Courtney "I'm forever in debt to your priceless advice" when they were arguing.

and that's pretty much it.

An error occured.