best--erotica.com
robots.txt
Robots Exclusion Standard data for best--erotica.com
Resource Scan
Scan Details
| Site Domain | best--erotica.com |
| Base Domain | best--erotica.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T20:09:33+00:00 |
| Next Scan | 2024-10-24T20:09:33+00:00 |
Last Scan
| Scanned | 2024-09-24T20:09:33+00:00 |
| URL | https://best--erotica.com/robots.txt |
| Domain IPs | 104.21.235.161, 104.21.235.162, 2606:4700:3038::6815:eba1, 2606:4700:3038::6815:eba2 |
| Response IP | 104.21.235.161 |
| Found | Yes |
| Hash | 9c9d28d48547d74f7adbccc5fef4756747d8774d77cff57052f368f427837049 |
| SimHash | ab0cc5642191 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://best--erotica.com/index.php?option=com_xmap&view=xml&id=3 |
Warnings
- `host` is not a known field.