Log In Sign Up

discussautos.com
robots.txt

Robots Exclusion Standard data for discussautos.com

Resource Scan

Scan Details

Site Domain discussautos.com
Base Domain discussautos.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-22T15:45:01+00:00
Next Scan 2024-08-20T15:45:01+00:00

Last Successful Scan

Scanned2021-08-18T13:03:46+00:00
URL https://discussautos.com/robots.txt
Found Yes
Hash 153de27c51027e37943943c90352cacae9914cba50c79d7aba5d22146a2bbd54
SimHash 4208dc806683

Groups

*

No rules defined. All paths allowed.

Back to top

Comments

  • vestacp autogenerated robots.txt
Back to top

Warnings

  • `crawl-delay` is not a known field.
Back to top