bestanimelist.com
robots.txt

Robots Exclusion Standard data for bestanimelist.com

Resource Scan

Scan Details

Site Domain bestanimelist.com
Base Domain bestanimelist.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-06T08:48:51+00:00
Next Scan 2025-02-04T08:48:51+00:00

Last Successful Scan

Scanned2023-10-14T00:10:23+00:00
URL https://bestanimelist.com/robots.txt
Domain IPs 104.21.86.206, 172.67.136.207, 2606:4700:3033::ac43:88cf, 2606:4700:3037::6815:56ce
Response IP 104.21.86.206
Found Yes
Hash 7c844f4bd354e22a845ba1b6394540f5552df9ee2ecb26e9fa038a287f4edd15
SimHash 41009c404db3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://bestanimelist.com/sitemap_index.xml