Log In Sign Up

diarioantofagasta.cl
robots.txt

Robots Exclusion Standard data for diarioantofagasta.cl

Resource Scan

Scan Details

Site Domain diarioantofagasta.cl
Base Domain diarioantofagasta.cl
Scan Status Ok
Last Scan2024-11-09T09:53:28+00:00
Next Scan 2024-11-16T09:53:28+00:00

Last Scan

Scanned2024-11-09T09:53:28+00:00
URL https://diarioantofagasta.cl/robots.txt
Domain IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash 5f9fa0b408d8e652fa5ea6e6ec40ce5a54c8810d47f2008e5272c18f761d78d5
SimHash 2901eb56c2b3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow *?replytocom

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.diarioantofagasta.cl/sitemap.xml
Back to top

Comments

  • disallow all files in these directories
Back to top