news.ustv.com.tw
robots.txt

Robots Exclusion Standard data for news.ustv.com.tw

Resource Scan

Scan Details

Site Domain news.ustv.com.tw
Base Domain ustv.com.tw
Scan Status Ok
Last Scan2024-06-10T21:29:58+00:00
Next Scan 2024-07-10T21:29:58+00:00

Last Scan

Scanned2024-06-10T21:29:58+00:00
URL https://news.ustv.com.tw/robots.txt
Redirect https://www.ustv.com.tw/robots.txt
Redirect Domain www.ustv.com.tw
Redirect Base ustv.com.tw
Domain IPs 34.111.98.22
Redirect IPs 34.111.98.22
Response IP 34.111.98.22
Found Yes
Hash 92738c8703091baaf9aac8ba28ea4ee392c4336bce6d27d9d29cd50a41bd6a53
SimHash 5000933acb35

Groups

*

Rule Path
Allow /ads.txt
Disallow /project
Disallow /ustv/release2.0/
Disallow /ustv/release3.0/
Disallow /ustv/status/
Disallow /report/

seekportbot
ahrefsbot
baidu
dotbot
everyonesocialbot
grapeshot
owlin
proximic
queryseekerspider
showyoubot
trendictionbot
umbot
yandex
ocelli
twiceler
openbot
openfind
openfind data gatherer
bbot
blp_bbot/0.1
blp_bbot
psbot/0.1
psbot
exabot/3.0
baiduspider+
yeti
snapbot/1.0

Rule Path
Disallow /

Comments

  • Googlebot
  • User-agent: Googlebot
  • Allow: *.css
  • Allow: *.js