Yes, and you could be eg: graylisted. Or server could accept all an silently drop. Or rate limit.
It's sad that VERIFY is basically dead due to spam. In the olden days, you might have been able to use finger - but it's also dead for (among other) similar reasons.
The spam cat and mouse game leads to quite silly situations for benign actors.
For some mx's you might be able to designate some ips as trusted, and do real verify for those.
