I don't think you should have to worry too much about Edwin's comments to Viconia, since I saw it as rather harmless, unless your extremely jealous.
The conversation I think should be addressed more closesly is one Edwin has with Mazzy, where he tells her "there is always a vacant space in my bedroll." It's the conversation that takes place AFTER they threaten each other (No doubt my knee caps are in some danger.)