animeforum.com
robots.txt
Robots Exclusion Standard data for animeforum.com
Resource Scan
Scan Details
| Site Domain | animeforum.com |
| Base Domain | animeforum.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T08:36:36+00:00 |
| Next Scan | 2024-10-01T08:36:36+00:00 |
Last Scan
| Scanned | 2024-09-24T08:36:36+00:00 |
| URL | https://animeforum.com/robots.txt |
| Domain IPs | 104.26.10.228, 104.26.11.228, 172.67.70.56 |
| Response IP | 104.26.10.228 |
| Found | Yes |
| Hash | 471b9cb374b4ab2bec0841a0a7e95a13db770df876fd3a019e2cb60dfbb8415b |
| SimHash | 2ab8da82c3e4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /register.php |
| Disallow | /search.php |
| Disallow | /thanks.php |
| Disallow | /memberlist.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
Warnings
- 2 invalid lines.