bothends.org
robots.txt
Robots Exclusion Standard data for bothends.org
Resource Scan
Scan Details
| Site Domain | bothends.org |
| Base Domain | bothends.org |
| Scan Status | Ok |
| Last Scan | 2025-09-21T15:13:00+00:00 |
| Next Scan | 2025-10-21T15:13:00+00:00 |
Last Scan
| Scanned | 2025-09-21T15:13:00+00:00 |
| URL | https://bothends.org/robots.txt |
| Redirect | https://www.bothends.org/robots.txt |
| Redirect Domain | www.bothends.org |
| Redirect Base | bothends.org |
| Domain IPs | 78.46.69.70 |
| Redirect IPs | 78.46.69.70 |
| Response IP | 78.46.69.70 |
| Found | Yes |
| Hash | 59da580e2ec8022cc7a2781a69cb4a51cabec28b0beb7e9c0092fa46009724b3 |
| SimHash | 61055494c391 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Admin/ |
| Disallow | /Admin/rootpw.txt |
| Disallow | /dialog/ |
| Disallow | /Testsuite/ |
| Disallow | /*?*action= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | /sitemap.php |