# csemer google-crawler...

User-agent: *

Disallow: /cgi-bin
Disallow: /mail
Disallow: /regi