The point is that there's no objective value to fruit (or anything for that matter).
For someone with allergy to that fruit it's worthless.
Aggregated preferences usually show that specialization (comparative advantage) helps satisfy everyone's preferences more that if everyone would just do their owns things. (Hence trade usually brings prosperity.)