cromosrepes.com
robots.txt

Robots Exclusion Standard data for cromosrepes.com

Resource Scan

Scan Details

Site Domain cromosrepes.com
Base Domain cromosrepes.com
Scan Status Ok
Last Scan2024-09-29T13:10:23+00:00
Next Scan 2024-10-06T13:10:23+00:00

Last Scan

Scanned2024-09-29T13:10:23+00:00
URL https://cromosrepes.com/robots.txt
Domain IPs 144.76.238.24
Response IP 144.76.238.24
Found Yes
Hash cea4f480a365127f4ee078f48a4c0ce5efb6384c5db4b536fb21581826bf84ac
SimHash ef1c485dcb9b

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /mensajes/
Disallow /misdatos/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://cromosrepes.com/sitemap-col.txt
sitemap https://cromosrepes.com/sitemap.txt