popo.tw
robots.txt

Robots Exclusion Standard data for popo.tw

Resource Scan

Scan Details

Site Domain popo.tw
Base Domain popo.tw
Scan Status Ok
Last Scan2024-11-13T21:35:09+00:00
Next Scan 2024-11-20T21:35:09+00:00

Last Scan

Scanned2024-11-13T21:35:09+00:00
URL https://popo.tw/robots.txt
Redirect https://www.popo.tw/robots.txt
Redirect Domain www.popo.tw
Redirect Base popo.tw
Domain IPs 27.105.200.65
Redirect IPs 27.105.200.65
Response IP 27.105.200.65
Found Yes
Hash a808d8f71636821ec9e992643499343221de7b841dee09dc4ed7a37e89d2842f
SimHash 053c9c616f90

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mediapartners-google

Rule Path
Disallow

yahooysmcm

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

google-extended

Rule Path
Disallow

googleother

Rule Path
Disallow

google-inspectiontool

Rule Path
Disallow

storebot-google

Rule Path
Disallow

googlebot

Rule Path
Disallow

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path Comment
Disallow /do-not-crawl/ disallow this directory

bingbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 600