Lyric discussion by rkpetersen 

Ditto what Solario said.

Also, 'Anastasia' isn't just some girl. Anastasia was the daughter of the Russian czar, who went missing after the rest of her family were killed in the Bolshevik revolution.

Here's a quote from Damian Kulash, who wrote the song, taken from an OK Go forum:

"the whole song is a response to sypathy for the devil. the stones' devil is responsible for all evil. our devil is just another bystander as people fuck everything up themselves."

An error occured.