sepuh88.online
robots.txt
Robots Exclusion Standard data for sepuh88.online
Resource Scan
Scan Details
Site Domain | sepuh88.online |
Base Domain | sepuh88.online |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-05-15T01:33:21+00:00 |
Next Scan | 2024-05-29T01:33:21+00:00 |
Last Successful Scan
Scanned | 2024-04-07T00:49:59+00:00 |
URL | https://sepuh88.online/robots.txt |
Domain IPs | 104.21.2.134, 172.67.129.64, 2606:4700:3033::ac43:8140, 2606:4700:3037::6815:286 |
Response IP | 104.21.2.134 |
Found | Yes |
Hash | 82f9994b7e8c49de735809dd27c858c5f203e841fea858ea7867fbdb3b60cb65 |
SimHash | 4e1cdc91e7c3 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments