I think thats bang on! I never ever use my phone while driving. If its important they will ring back, and if you must answer it then pull over first.
On a lighter note: Annoy policemen by driving with your TV remote pressed against your ear, and when they pull you over just look at them blankly and say "what?".
Only kiddin.

Just don't do it, its a distraction and is dangerouse!