appister.com
robots.txt

Robots Exclusion Standard data for appister.com

Resource Scan

Scan Details

Site Domain appister.com
Base Domain appister.com
Scan Status Ok
Last Scan2025-10-18T19:23:14+00:00
Next Scan 2025-11-17T19:23:14+00:00

Last Scan

Scanned2025-10-18T19:23:14+00:00
URL https://appister.com/robots.txt
Redirect https://xiangjiaoys.com/robots.txt
Redirect Domain xiangjiaoys.com
Redirect Base xiangjiaoys.com
Domain IPs 104.21.69.179, 172.67.211.3, 2606:4700:3032::6815:45b3, 2606:4700:3035::ac43:d303
Redirect IPs 23.225.178.179
Response IP 23.225.178.179
Found Yes
Hash 9fec8a9d0fc30954b7ea66f135dd5cc214f337277fb8230cd9337951a0e26c8e
SimHash 48ce361287b4

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /application/
Disallow /runtime/
Disallow /vendor/
Disallow /static/install/
Disallow /upload/temp/
Disallow /api/
Disallow /user/login
Disallow /user/register
Disallow /search?*
Disallow /*?*page=
Disallow /*%26page%3D

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

sogou

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://xiangjiaoys.com/rss/sitemap.xml

Comments

  • robots.txt for xiangjiaoys.com
  • å
  • 不å
  • 百度爬虫特殊规则
  • 谷歌爬虫特殊规则
  • 360爬虫规则
  • 搜狗爬虫规则
  • 网站地图位置
  • 主机地址

Warnings

  • 5 invalid lines.
  • `host` is not a known field.