Log In Sign Up

blog.soft.idv.tw
robots.txt

Robots Exclusion Standard data for blog.soft.idv.tw

Resource Scan

Scan Details

Site Domain blog.soft.idv.tw
Base Domain soft.idv.tw
Scan Status Ok
Last Scan2025-09-09T10:35:23+00:00
Next Scan 2025-10-09T10:35:23+00:00

Last Scan

Scanned2025-09-09T10:35:23+00:00
URL https://blog.soft.idv.tw/robots.txt
Redirect https://pcrookie.com/robots.txt
Redirect Domain pcrookie.com
Redirect Base pcrookie.com
Domain IPs 104.21.5.243, 172.67.134.11, 2606:4700:3033::ac43:860b, 2606:4700:3036::6815:5f3
Redirect IPs 61.216.106.4
Response IP 61.216.106.4
Found Yes
Hash 96c9308dfa50b86850837dcb5ecc4328ad64f6b67ef62303dfe4405424ab0d17
SimHash 14b45c402fd2

Groups

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path Comment
Disallow /do-not-crawl/ disallow this directory

*

Product Comment
* any robot
Rule Path Comment
Disallow /not-allowed/ disallow this directory
Back to top

Other Records

Field Value
sitemap https://pcrookie.com/sitemap.xml
Back to top

Comments

  • User-agent: baiduspider
  • Disallow: /
  • BEGIN XML-SITEMAP-PLUGIN
  • END XML-SITEMAP-PLUGIN
Back to top