Even disregarding the sonic boom, why would we even want mediocre civil pilots to have access to aircraft thag are necessarily more dangerous and more destructive in the event of a crash?
Planes usually crash at takeoff and landing, hence supersonic or not doesn't matter for that case.
Crashing at any other time, sure, there is potentially more energy in a supersonic plane. I doubt that people on the ground will know the difference between a plane crashing on them at 600mph vs 1200mph.