Ooohh...this "eyes wandered" thing really strikes a nerve. I've been working really hard to "retrain" myself to avoid those wandering body parts problems. Things like:
Clark's eyes bored into Lois's, making her squirm.OR
Lois held his eyes while licking her lips, telling him wordlessly that now was the time to kiss her.In both instances "eyes" isn't correct but rather "gaze", except I'm so used to using "eyes" and "gaze" interchangeably that it is hard to stop.
So seeing that several of you forgo the "rule" in favor of just using a common expression is reassuring. Perhaps it's okay to have wandering eyes on occasion.

Lynn