takipci.pw
robots.txt

Robots Exclusion Standard data for takipci.pw

Resource Scan

Scan Details

Site Domain takipci.pw
Base Domain takipci.pw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-06-29T18:06:04+00:00
Next Scan 2025-09-27T18:06:04+00:00

Last Successful Scan

Scanned2025-02-07T14:44:34+00:00
URL https://takipci.pw/robots.txt
Domain IPs 104.21.11.146, 172.67.149.122, 2606:4700:3032::ac43:957a, 2606:4700:3034::6815:b92
Response IP 104.21.11.146
Found Yes
Hash be382a967e9da41e18aed942720c26e7c07f423f53c44d751cc8f02dc77c8ca7
SimHash 4015da105595

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Product Comment
slurp Yahoo 的爬虫
Rule Path
Allow /

duckduckbot

Product Comment
duckduckbot DuckDuckGo 的爬虫
Rule Path
Allow /

*

Rule Path
Disallow /

Comments

  • å
  • 屏蔽å

Warnings

  • 2 invalid lines.