hola gracias por tu pronta respuesta, entonces quedaría:
Código:
User-agent: *
Allow: /
Disallow:
Disallow: /access/
Disallow: /administracion/
Disallow: /ckeditor/
Disallow: /conexion_mysql/
Disallow: /css/
Disallow: /js/
Disallow: /perfiles/
Disallow: /source/
Crawl-delay: 30
Sitemap: http://www.buzonxalapa.com/sitemap.xml
User-agent: duggmirror
Disallow: /
User-agent: wget
Disallow: /
User-agent: MSIECrawler
Disallow: /
User-agent: WebCopier
Disallow: /
User-agent: HTTrack
Disallow: /
User-agent: Microsoft.URL.Control
Disallow: /
User-agent: libwww
Disallow: /