lavadodesalascdmx.mx
robots.txt

Robots Exclusion Standard data for lavadodesalascdmx.mx

Resource Scan

Scan Details

Site Domain lavadodesalascdmx.mx
Base Domain lavadodesalascdmx.mx
Scan Status Ok
Last Scan2024-09-22T13:33:50+00:00
Next Scan 2024-10-22T13:33:50+00:00

Last Scan

Scanned2024-09-22T13:33:50+00:00
URL https://lavadodesalascdmx.mx/robots.txt
Domain IPs 104.21.1.215, 172.67.152.90, 2606:4700:3035::ac43:985a, 2606:4700:3036::6815:1d7
Response IP 172.67.152.90
Found Yes
Hash 498bae790da5c9e12ab6d983f817f57da1f8c4bf13107131859a58eb88f42776
SimHash 6bbcc8426c3b

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /wp-content/plugins/ -
Disallow /wp-content/cache/ -
Disallow /wp-content/themes/ -
Disallow /trackback/ -
Disallow /cgi-bin/ -
Disallow /comments/ -
Disallow /xmlrpc.php -
Disallow /wp-login.php -
Disallow /wp-signup.php -
Disallow /?s= -
Disallow /search/ -
Disallow /*/feed/ -
Disallow /*/trackback/ -
Disallow /*/comments/ -
Disallow /*?* -
Disallow /private/ Añadir si tienes un directorio privado que no quieres indexado
Allow /wp-admin/admin-ajax.php -
Disallow /wp-content/uploads/ -
Allow /wp-content/uploads/*.jpg -
Allow /wp-content/uploads/*.png -
Allow /wp-content/uploads/*.gif -

badbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://lavadodesalascdmx.mx/sitemap_index.xml
sitemap https://lavadodesalascdmx.mx/page-sitemap.xml

Comments

  • Global settings for all bots
  • Allow AJAX functionality
  • Media files - restrict indexation of images
  • Blocking unwanted bots
  • Sitemap location