Good point. I've been aware of this for a while, since I have a 96 Viper GTS coupe, and you can't even drive it with big shoes on. I agree, wrestling shoes are a good alternative. Powerlifters use them when deadlifting since they have thin soles (less distance you have to raise the bar).
I drove my Viper cross country and back barefooted one summer. All I had to do was curl my big toe on the accelerator and I would rocket from 60 to 140. When I stopped for gas, or to eat or sleep, I would just throw out a pair of sandals and slip into them on the way out of the car. That was a fun trip.

Went from the west coast to the east coast in two days.