I like driving, I also like the assistance that modern vehicles provide on Motorways, however, would I ever fully hand over control? Probably not. A Boeing 747 has autopilot.. however 3 pilots sit behind hit to keep an eye on what it's doing.
The ratio of pilot to total people on the plane is often something like 1/100. In a cars it might average 1/1.2 or something. I think that should be improved.
Also, on a plane, those pilots are never expected to jump in with 2 seconds notice because something isn't working right. I don't think that is realistic....people zone out, but that is expected in "supervised self driving".