swybae.com
robots.txt
Robots Exclusion Standard data for swybae.com
Resource Scan
Scan Details
Site Domain | swybae.com |
Base Domain | swybae.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-02T11:19:06+00:00 |
Next Scan | 2024-12-01T11:19:06+00:00 |
Last Successful Scan
Scanned | 2023-05-11T06:17:31+00:00 |
URL | https://swybae.com/robots.txt |
Domain IPs | 195.201.215.13, 2a01:4f8:d0a:6469::2 |
Response IP | 195.201.215.13 |
Found | Yes |
Hash | 356f46801d586a75a63fa8ab59e8a5e7528cab5c447925ec226de52695a5ddf2 |
SimHash | 125a4440817a |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 2 invalid lines.
Comments