ubweekly.com.tw
robots.txt

Robots Exclusion Standard data for ubweekly.com.tw

Resource Scan

Scan Details

Site Domain ubweekly.com.tw
Base Domain ubweekly.com.tw
Scan Status Ok
Last Scan2024-11-10T06:33:12+00:00
Next Scan 2024-11-17T06:33:12+00:00

Last Scan

Scanned2024-11-10T06:33:12+00:00
URL http://ubweekly.com.tw/robots.txt
Domain IPs 34.149.105.14
Response IP 34.149.105.14
Found Yes
Hash 7b46c6895e990d1558a1b38c759fe1b6224db47bbf095d8989eff08fd097d68f
SimHash 5000933acb35

Groups

*

Rule Path
Allow /ads.txt
Disallow /project
Disallow /ustv/release2.0/
Disallow /ustv/status/
Disallow /report/

seekportbot
ahrefsbot
baidu
dotbot
everyonesocialbot
grapeshot
owlin
proximic
queryseekerspider
showyoubot
trendictionbot
umbot
yandex
ocelli
twiceler
openbot
openfind
openfind data gatherer
bbot
blp_bbot/0.1
blp_bbot
psbot/0.1
psbot
exabot/3.0
baiduspider+
yeti
snapbot/1.0

Rule Path
Disallow /

Comments

  • Googlebot
  • User-agent: Googlebot
  • Allow: *.css
  • Allow: *.js