Well I'm pretty sure they were in fact all you. It sounds as if you might be experiencing some internal conflict which probably only you can decipher. Though I would bet that some kind of sexual misunderstanding is taking place with in your psyche.
Not sure that there is really a way of solving this other than just living your life and dealing with all the aspects of it as they happen. The sexual misunderstanding part depends on what you believe. My comment runs along the lines of you perhaps having a previous lifetime, Reincarnation, where you were the opposite sex and still may have some residual memories that followed into this lifetime. I know that I have them, but admit that it is hard to explain beyond just knowing that I have female traits that awaken at times that are not of my current life experience. Hope that makes sense!