I could see it happening maybe once or twice.  Even so, it would still be weird as hell.  As Louis C.K. said, masturbation is a magical thing.  You can fantasize about any woman you want, real or imaginary.  With all that limitless potential and with petabytes of free porn seldom more than an arm's reach away (smart phones with internet access), why would anyone fantasize about someone they already have?