block.one
robots.txt
Robots Exclusion Standard data for block.one
Resource Scan
Scan Details
Site Domain | block.one |
Base Domain | block.one |
Scan Status | Ok |
Last Scan | 2024-04-30T11:46:40+00:00 |
Next Scan | 2024-05-30T11:46:40+00:00 |
Last Scan
Scanned | 2024-04-30T11:46:40+00:00 |
URL | https://block.one/robots.txt |
Redirect | https://b1.com/robots.txt |
Redirect Domain | b1.com |
Redirect Base | b1.com |
Domain IPs | 192.124.249.102 |
Redirect IPs | 192.124.249.128 |
Response IP | 192.124.249.128 |
Found | Yes |
Hash | a02254e5c6efab9e7054937c2d0e1264c8704668103626f4f99ddd9e16381caf |
SimHash | 4809cc80e3b5 |
Groups
*
Rule | Path |
---|---|
Disallow | /calendar/action* |
Disallow | /events/action* |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |