How about something along these lines (http://blog.shimaore.net/2009/03/better-followme-for-freeswitch.html).

If a user fails to confirm then assume it's a robot and move along your dialplan ?

B