carnews.com.mx
robots.txt

Robots Exclusion Standard data for carnews.com.mx

Resource Scan

Scan Details

Site Domain carnews.com.mx
Base Domain carnews.com.mx
Scan Status Ok
Last Scan2024-06-01T18:27:02+00:00
Next Scan 2024-06-08T18:27:02+00:00

Last Scan

Scanned2024-06-01T18:27:02+00:00
URL http://carnews.com.mx/robots.txt
Domain IPs 50.63.8.6
Response IP 50.63.8.6
Found Yes
Hash b037192c858b12dd18fc7dea365f0f94ee0592cf33269b0c2b88efee9016e1b6
SimHash 610cdc5146b7

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap http://carnews.com.mx/sitemap.xml