ustv.com.tw
robots.txt

Robots Exclusion Standard data for ustv.com.tw

Resource Scan

Scan Details

Site Domain ustv.com.tw
Base Domain ustv.com.tw
Scan Status Ok
Last Scan2024-11-11T07:21:06+00:00
Next Scan 2024-11-18T07:21:06+00:00

Last Scan

Scanned2024-11-11T07:21:06+00:00
URL https://www.ustv.com.tw/robots.txt
Domain IPs 34.111.98.22
Response IP 34.111.98.22
Found Yes
Hash 7b46c6895e990d1558a1b38c759fe1b6224db47bbf095d8989eff08fd097d68f
SimHash 5000933acb35

Groups

*

Rule Path
Allow /ads.txt
Disallow /project
Disallow /ustv/release2.0/
Disallow /ustv/status/
Disallow /report/

seekportbot
ahrefsbot
baidu
dotbot
everyonesocialbot
grapeshot
owlin
proximic
queryseekerspider
showyoubot
trendictionbot
umbot
yandex
ocelli
twiceler
openbot
openfind
openfind data gatherer
bbot
blp_bbot/0.1
blp_bbot
psbot/0.1
psbot
exabot/3.0
baiduspider+
yeti
snapbot/1.0

Rule Path
Disallow /

Comments

  • Googlebot
  • User-agent: Googlebot
  • Allow: *.css
  • Allow: *.js