arenafan.com
robots.txt
Robots Exclusion Standard data for arenafan.com
Resource Scan
Scan Details
| Site Domain | arenafan.com |
| Base Domain | arenafan.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T20:48:02+00:00 |
| Next Scan | 2024-11-15T20:48:02+00:00 |
Last Scan
| Scanned | 2024-11-08T20:48:02+00:00 |
| URL | https://arenafan.com/robots.txt |
| Domain IPs | 207.32.186.100 |
| Response IP | 207.32.186.100 |
| Found | Yes |
| Hash | 25dcfbf86b710a2142827403d6b1406830aef1cfb6c85c00df04e54214ddf142 |
| SimHash | 2018dcc0c2a0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /phpBB2* |
| Disallow | /chat08* |
| Disallow | /graphics* |
| Disallow | /adbanners* |
| Disallow | /content* |
| Disallow | /gallery* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |