la-prensa.com.mx
robots.txt

Robots Exclusion Standard data for la-prensa.com.mx

Resource Scan

Scan Details

Site Domain la-prensa.com.mx
Base Domain la-prensa.com.mx
Scan Status Ok
Last Scan2024-11-16T08:39:23+00:00
Next Scan 2024-11-23T08:39:23+00:00

Last Scan

Scanned2024-11-16T08:39:23+00:00
URL https://la-prensa.com.mx/robots.txt
Redirect https://www.la-prensa.com.mx/robots.txt
Redirect Domain www.la-prensa.com.mx
Redirect Base la-prensa.com.mx
Domain IPs 34.195.171.188, 34.196.106.61
Redirect IPs 18.161.111.122, 18.161.111.2, 18.161.111.20, 18.161.111.91
Response IP 18.165.122.60
Found Yes
Hash 7e67f625dbc4e8ade74587615e89977a13ea6c2d9d0a428ae73d605baeadab74
SimHash 60205c204b93

Groups

*

Rule Path
Disallow /*buscar/

Other Records

Field Value
crawl-delay 2

grapeshot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.la-prensa.com.mx/sitemap/update.xml