pigo.idv.tw
robots.txt

Robots Exclusion Standard data for pigo.idv.tw

Resource Scan

Scan Details

Site Domain pigo.idv.tw
Base Domain pigo.idv.tw
Scan Status Ok
Last Scan2025-10-28T17:35:54+00:00
Next Scan 2025-11-04T17:35:54+00:00

Last Scan

Scanned2025-10-28T17:35:54+00:00
URL https://pigo.idv.tw/robots.txt
Domain IPs 104.21.3.144, 172.67.130.209, 2606:4700:3033::6815:390, 2606:4700:3036::ac43:82d1
Response IP 172.67.130.209
Found Yes
Hash 0b14edf80bc9d646ac538859c1ea30e337516101431089e662ea4351a07f3fd4
SimHash bc24c10ae9d2

Groups

*

Rule Path
Disallow /wpg2
Disallow /download-files
Disallow /wp-login.php

Comments

  • 防止爬蟲抓以下列表