animaltoyforum.com
robots.txt
Robots Exclusion Standard data for animaltoyforum.com
Resource Scan
Scan Details
| Site Domain | animaltoyforum.com |
| Base Domain | animaltoyforum.com |
| Scan Status | Ok |
| Last Scan | 2024-07-05T14:59:51+00:00 |
| Next Scan | 2024-07-06T14:59:51+00:00 |
Last Scan
| Scanned | 2024-07-05T14:59:51+00:00 |
| URL | https://animaltoyforum.com/robots.txt |
| Domain IPs | 104.21.69.28, 172.67.203.48, 2606:4700:3033::ac43:cb30, 2606:4700:3034::6815:451c |
| Response IP | 104.21.69.28 |
| Found | Yes |
| Hash | be4348c23b0f9bd1afa2bee9860a4311be5bcf075510ea0cabd63b6ce9182feb |
| SimHash | 2f52457e0881 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*action |
| Disallow | /*board%3D*wap |
| Disallow | /*board%3D*imode |
| Disallow | /*topic%3D*wap |
| Disallow | /*topic%3D*imode |
| Disallow | /*topic%3D*.msg |
| Disallow | /*topic%3D*.new |
| Disallow | /*PHPSESSID |
| Disallow | /*%3B |
| Allow | /$ |
| Allow | /*board |
| Allow | /*topic |
| Allow | /*.xml |
| Allow | /*sitemap |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | .css |
Other Records
| Field | Value |
|---|---|
| sitemap | http://animaltoyforum.com/sitemap.xml |