un4seen.com
robots.txt
Robots Exclusion Standard data for un4seen.com
Resource Scan
Scan Details
| Site Domain | un4seen.com |
| Base Domain | un4seen.com |
| Scan Status | Ok |
| Last Scan | 2024-10-19T11:45:40+00:00 |
| Next Scan | 2024-11-18T11:45:40+00:00 |
Last Scan
| Scanned | 2024-10-19T11:45:40+00:00 |
| URL | https://un4seen.com/robots.txt |
| Redirect | http://www.un4seen.com/robots.txt |
| Redirect Domain | www.un4seen.com |
| Redirect Base | un4seen.com |
| Domain IPs | 13.35.238.17, 13.35.238.73, 13.35.238.85, 13.35.238.95 |
| Redirect IPs | 13.33.183.112, 13.33.183.122, 13.33.183.38, 13.33.183.83 |
| Response IP | 13.35.238.73 |
| Found | Yes |
| Hash | 6deaec66ff245bebfe8f1efb9a1b59621e1f21375145750ce9ce128c08d37f8f |
| SimHash | 6814ddc4da13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /files/ |
| Disallow | /stuff/ |
| Disallow | /forum*action%3D |
| Disallow | /forum*.msg |
| Disallow | /forum*%3Ball |
| Disallow | /forum*%3Bprev_next%3D |
| Disallow | /forum*%3Bsort%3D |
| Disallow | /forum*wap2 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |