This is the basis for the general public recommendation against gloves. In order for gloves to provide any benefit over hand washing, they have to be changed at least as often as you would wash your hands. That's a tremendous amount of waste. The reasons health care workers do this should be obvious - to limit cross-contamination. As many of us have probably experienced, there's only so much soap/sanitizer your skin can take in a day, and that's where gloves come in.
Not much issue if someone wants to wear gloves to do their grocery shopping once a week, but if we have regular people changing out gloves like they're healthcare workers thinking that's a good idea, my heart weeps for the environment...
I don't care if people want to use gloves either, but washing your hands is no worse of an alternative for the normal person. People feel a false sense of security with gloves.