Lyric discussion by tomStrangelove 

I think "No, I never wanted to change the world, but I'm looking for a new New Jersey" might be a reference to Billy Bragg's song New England where he sings "I don't want to change the world I'm not looking for a New england I'm just looking for another girl"

The statement is he is not looking to change the world or looking to change the place where he lives either but looking for another girl.

Since in this song he is not looking to change the world but is looking to change the place he lives perhaps he therefore is not looking for another girl.

Or to be less literal wanting to not focus on his personal problems but something big (new jersey and perhaps the state of the union itself) but not lose touch with the place he lives (hence not change the world).

Probably reading too much into that but there you go.

this song (and the last one, and Titus Andronicus Forever ...And Ever) are about trying to escape New Jersey to Boston, where he thought he would be free of "The Enemy" (essentially, douchebags). New Jersey had failed him so he tried to escape. This song is about him trying ton find a new start. The Battle of Hampton Roads is about him coming back to Jersey after realizing that "The Enemy is everywhere".

dude that's awesome, this band is great.

In their interview with Spin, Patrick Stickles said he wrote most of the album after going through a bad breakup and watching a ton of movies/reading a ton of books about the Civil War. So it is very well plausible that he is "looking for another girl".

An error occured.