There's a gap in one of the streets where I lived, which is where the houses were bombed during WWII and the council decided to put in a park instead. Missing numbers don't normally cause any confusion, except that I had a beggar come round once or twice claiming to be a neighbour with an emergency - and they gave one of the numbers that didn't exist.