In a small tribe, hurting your fellow man affects you. If you screw over your only hunter and he becomes homeless, it's both a problem for you and him. He's spending time repairing his place instead of getting food for everyone.

At scale, you'll never even know he exists and are free to leech everything you can out of him.