toolizer.cc
robots.txt

Robots Exclusion Standard data for toolizer.cc

Resource Scan

Scan Details

Site Domain toolizer.cc
Base Domain toolizer.cc
Scan Status Ok
Last Scan2025-11-17T10:07:40+00:00
Next Scan 2025-11-24T10:07:40+00:00

Last Scan

Scanned2025-11-17T10:07:40+00:00
URL https://toolizer.cc/robots.txt
Domain IPs 104.21.8.14, 172.67.156.159, 2606:4700:3033::6815:80e, 2606:4700:3033::ac43:9c9f
Response IP 172.67.156.159
Found Yes
Hash 8e8d84d5f17ca17ca147214339095d0299630045d1dcf0f79ff94aaded1f3674
SimHash 090d8a32c2b3

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://toolizer.cc/sitemap.xml
sitemap https://toolizer.cc/sitemap.txt

Comments

  • Sitemap
  • 禁止爬取特定目錄(如果有的話)
  • Disallow: /admin/
  • Disallow: /private/