Lyric discussion by DrFlipflops 

She's afraid to know the truth of his mind. He only wants her part of the time. He tells her "she" might overhear. To mention "Tear him away," "trouble I'll get," and the mention of the other woman, who is to be feared by both speaks to the fact that she is acquainted with his wife/ or other woman.

She's obviously his mistress and he likes her but he wants to keep it a secret because it would mean trouble if his regular girl found out.

An error occured.