autocosmos.cr
robots.txt

Robots Exclusion Standard data for autocosmos.cr

Resource Scan

Scan Details

Site Domain autocosmos.cr
Base Domain autocosmos.cr
Scan Status Ok
Last Scan2024-11-11T18:02:09+00:00
Next Scan 2024-11-18T18:02:09+00:00

Last Scan

Scanned2024-11-11T18:02:09+00:00
URL https://autocosmos.cr/robots.txt
Domain IPs 40.119.12.19
Response IP 40.119.12.19
Found Yes
Hash b15656646221ae26ce2055739b84cc2539cc419f8f00a3e947ce3c08fb2b8660
SimHash 6158cdb144f4

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /myspace/
Disallow /contactar/
Disallow /navigationerror/
Disallow /search
Disallow /cuentas/
Disallow /registro/

googlebot

Rule Path
Disallow /myspace/
Disallow /contactar/
Disallow /navigationerror/
Disallow /search
Disallow /cuentas/
Disallow /registro/

googlebot-image

Rule Path
Allow /catalogo/
Allow /autos/
Allow /auto/
Disallow /