OP,
I suggest you put the skill "attack" on your hot key bar and assign it a key.
When attack is used on an NPC (or an item) it will walk up to it & loot/talk to it.
Raising affinity isn't an issue.
I set mine to "Z" and I jump loot & talk to NPC's without my mouse.