weldingweb.com
robots.txt

Robots Exclusion Standard data for weldingweb.com

Resource Scan

Scan Details

Site Domain weldingweb.com
Base Domain weldingweb.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-18T22:06:50+00:00
Next Scan 2024-07-17T22:06:50+00:00

Last Successful Scan

Scanned2023-09-22T16:18:18+00:00
URL https://weldingweb.com/robots.txt
Domain IPs 104.16.248.51, 104.16.249.51
Response IP 104.16.249.51
Found Yes
Hash 7150531ac68b18f08198698c492dae09d34bcb9de4011d2d954cb8083382ba30
SimHash 6800dc00e392

Groups

*

Rule Path
Disallow

Comments

  • Crawl-Delay: 10