wikibanderas.com
robots.txt
Robots Exclusion Standard data for wikibanderas.com
Resource Scan
Scan Details
| Site Domain | wikibanderas.com |
| Base Domain | wikibanderas.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-06-15T23:34:40+00:00 |
| Next Scan | 2025-09-13T23:34:40+00:00 |
Last Successful Scan
| Scanned | 2024-08-20T19:31:23+00:00 |
| URL | https://wikibanderas.com/robots.txt |
| Domain IPs | 104.21.75.4, 172.67.209.246, 2606:4700:3031::6815:4b04, 2606:4700:3037::ac43:d1f6 |
| Response IP | 172.67.209.246 |
| Found | Yes |
| Hash | 847a8d95f9685134d858dc68f4b71abdab14132097875dee04a1727b89e48ec7 |
| SimHash | 2d084dc10193 |
Groups
*
| Rule | Path |
|---|---|
| Allow | * |
| Disallow | /assets/css |
| Disallow | /assets/fonts |
| Disallow | /assets/js |
| Disallow | /ca/cookies |
| Disallow | /ca/privacitat |
| Disallow | /es/cookies |
| Disallow | /es/privacidad |
| Disallow | /en/cookies |
| Disallow | /en/privacy |
| Disallow | /error |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://domini.com/sitemap.xml |