13city.org
robots.txt

Robots Exclusion Standard data for 13city.org

Resource Scan

Scan Details

Site Domain 13city.org
Base Domain 13city.org
Scan Status Ok
Last Scan2025-11-16T01:44:18+00:00
Next Scan 2025-12-16T01:44:18+00:00

Last Scan

Scanned2025-11-16T01:44:18+00:00
URL https://13city.org/robots.txt
Domain IPs 104.21.87.29, 172.67.140.20, 2606:4700:3030::6815:571d, 2606:4700:3030::ac43:8c14
Response IP 172.67.140.20
Found Yes
Hash e36b51f8867f6e108d7a4f29c37859be36fb3464e96b383c3ce83a47d8a50d82
SimHash 25594315e25f

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /
Disallow /login.php
Disallow /signup.php
Disallow /usercp.php
Disallow /staff.php
Disallow /admin.php
Disallow /takelogin.php
Disallow /takesignup.php
Disallow /takestaffmess.php
Disallow /ajax.php
Disallow /announce.php
Disallow /attachment.php
Disallow /scrape.php
Disallow /task.php
Disallow /userdetails.php
Disallow /usersearch.php
Disallow /userhistory.php
Disallow /users.php
Disallow /my.php
Disallow /messages.php
Disallow /admanage.php
Disallow /modtask.php
Disallow /modcomment.php
Disallow /modrules.php
Disallow /bans.php
Disallow /warned.php
Disallow /*.php$
Disallow /*.sql$
Disallow /*.log$
Disallow /*.inc$
Disallow /*.conf$
Disallow /*.txt$

Comments

  • 禁止所有搜索引擎爬虫访问
  • 特别禁止主流搜索引擎爬虫
  • 禁止爬虫访问特定文件和目录(基于实é™
  • 用户认证和管理相å
  • 功能接口文件
  • 用户隐私相å
  • 管理功能文件
  • 特定文件类型

Warnings

  • 5 invalid lines.