carcrete24.com
robots.txt

Robots Exclusion Standard data for carcrete24.com

Resource Scan

Scan Details

Site Domain carcrete24.com
Base Domain carcrete24.com
Scan Status Ok
Last Scan2024-06-13T20:30:26+00:00
Next Scan 2024-06-20T20:30:26+00:00

Last Scan

Scanned2024-06-13T20:30:26+00:00
URL https://carcrete24.com/robots.txt
Redirect https://www.carcrete24.com/robots.txt
Redirect Domain www.carcrete24.com
Redirect Base carcrete24.com
Domain IPs 78.47.202.105
Redirect IPs 78.47.202.105
Response IP 78.47.202.105
Found Yes
Hash 38cd581b2dd1a6a147f4a8ec32da4f79967509a72c2f352779c21dc6e80da5d1
SimHash 4340dc534731

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Warnings

  • `host` is not a known field.