fm-anime.com
robots.txt

Robots Exclusion Standard data for fm-anime.com

Resource Scan

Scan Details

Site Domain fm-anime.com
Base Domain fm-anime.com
Scan Status Ok
Last Scan2026-02-05T13:41:03+00:00
Next Scan 2026-03-07T13:41:03+00:00

Last Scan

Scanned2026-02-05T13:41:03+00:00
URL https://fm-anime.com/robots.txt
Domain IPs 104.21.9.221, 172.67.131.12, 2606:4700:3035::6815:9dd, 2606:4700:3037::ac43:830c
Response IP 172.67.131.12
Found Yes
Hash 37898e72b03b468d47ae95e6d5386987de67984c79fa665a83889cf8cee1091a
SimHash 8417f172ca79

Groups

*

Rule Path Comment
Disallow /*? -
Allow /*?page= -
Allow /*?p= -
Allow /graphql? -
Disallow /*SID%3D -
Disallow /*?_*= -
Disallow /*?price= -
Disallow /*?color= -
Disallow /*?size= -
Disallow /*?brand= -
Disallow /*?product_list_mode= 屏蔽不同的产品列表模式
Disallow /*?currency= 屏蔽不同的货币参数
Disallow /customer/account/login/referer/ 屏蔽登录后的重定向URL
Disallow /repo/ -
Disallow /catalog/product_compare/ -
Disallow /catalog/category/view/ -
Disallow /catalog/product/view/ -
Disallow /catalog/seo_sitemap/ -
Disallow /catalogsearch/ -
Disallow /mfproductsearch/ -
Disallow /checkout/ -
Disallow /control/ -
Disallow /customer/ -
Disallow /customize/ -
Disallow /sendfriend/ -
Disallow /ajaxcart/ -
Disallow /ajax/ -
Disallow /quickview/ -
Disallow /productalert/ -
Disallow /mfcmsdr/ -
Disallow /sales/guest/form/ -
Disallow /review/ -
Disallow /downloadable/ -
Disallow /pslogin/ -
Disallow /subscription/ -
Disallow /newsletter/ -
Disallow /push_notification/ -
Disallow /index.php -
Disallow /cron.php -
Disallow /cron.sh -
Disallow /error_log -
Disallow /install.php -
Disallow /LICENSE.html -
Disallow /LICENSE.txt -
Disallow /LICENSE_AFL.txt -
Disallow /STATUS.txt -
Disallow /get.php -
Disallow /app/ -
Disallow /lib/ -
Disallow /*.php$ -
Disallow /pkginfo/ -
Disallow /report/ -
Disallow /var/ -
Disallow /privacy-policy-cookie-restriction-mode -
Disallow /no-route -
Disallow /enable-cookies -

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

kmsdbot

Rule Path
Disallow /

Comments

  • Define user agents/bots
  • Urls with parameters
  • Login redirects
  • Technical paths
  • Files
  • CMS Pages
  • Block specific bad bots known for poor behavior
  • Additional custom blocked user agents