No, the votes don't matter. Ironically, in fact, I think I got pity upvotes for the plea, which are not really helpful. What does matter is that I'm expressing myself effectively and the votes usually operate as feedback to that effect.
I'm still curious about the motivations of those downvoters.
Also, I apologize for the meta discussion in this already off-topic thread.