underdogseattle.com
robots.txt

Robots Exclusion Standard data for underdogseattle.com

Resource Scan

Scan Details

Site Domain underdogseattle.com
Base Domain underdogseattle.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-19T09:02:06+00:00
Next Scan 2024-08-17T09:02:06+00:00

Last Successful Scan

Scanned2022-12-30T16:26:36+00:00
URL https://underdogseattle.com/robots.txt
Domain IPs 18.155.68.127, 18.155.68.18, 18.155.68.4, 18.155.68.54
Response IP 18.155.68.54
Found Yes
Hash ee9791d42586d17150d6d96cf9a82bbb270f29573b38c275ce2057ec10a40eb3
SimHash a91cdc60e3d1

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5