Obviously the vast majority of film-viewers won't stand up and say, "What!? The eyeline didn't match. How dare they?" But sloppy things like that can lead to a disjointed feel of a film. "Invisible editing" is essential for certain kinds of films, irrelevant for others.