applesana.es
robots.txt
Robots Exclusion Standard data for applesana.es
Resource Scan
Scan Details
Site Domain | applesana.es |
Base Domain | applesana.es |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-13T03:55:43+00:00 |
Next Scan | 2024-11-20T03:55:43+00:00 |
Last Successful Scan
Scanned | 2024-11-11T00:49:27+00:00 |
URL | https://applesana.es/robots.txt |
Domain IPs | 104.21.39.68, 172.67.143.146, 2606:4700:3031::ac43:8f92, 2606:4700:3034::6815:2744 |
Response IP | 104.21.39.68 |
Found | Yes |
Hash | 75e3bec6ddcaa301a6ac2f3cdb4bbfeedf2e4b699f32b6bc6ee609cd22e10004 |
SimHash | 5bcfd4508a20 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | *.csv |
Other Records
Field | Value |
---|---|
sitemap | https://applesana.es/sitemap.xml |