bestanimelist.com
robots.txt
Robots Exclusion Standard data for bestanimelist.com
Resource Scan
Scan Details
Site Domain | bestanimelist.com |
Base Domain | bestanimelist.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-11-06T08:48:51+00:00 |
Next Scan | 2025-02-04T08:48:51+00:00 |
Last Successful Scan
Scanned | 2023-10-14T00:10:23+00:00 |
URL | https://bestanimelist.com/robots.txt |
Domain IPs | 104.21.86.206, 172.67.136.207, 2606:4700:3033::ac43:88cf, 2606:4700:3037::6815:56ce |
Response IP | 104.21.86.206 |
Found | Yes |
Hash | 7c844f4bd354e22a845ba1b6394540f5552df9ee2ecb26e9fa038a287f4edd15 |
SimHash | 41009c404db3 |
Other Records
Field | Value |
---|---|
sitemap | https://bestanimelist.com/sitemap_index.xml |