tvl.ctvba.org.tw
robots.txt

Robots Exclusion Standard data for tvl.ctvba.org.tw

Resource Scan

Scan Details

Site Domain tvl.ctvba.org.tw
Base Domain ctvba.org.tw
Scan Status Ok
Last Scan2025-09-15T14:35:10+00:00
Next Scan 2025-10-15T14:35:10+00:00

Last Scan

Scanned2025-09-15T14:35:10+00:00
URL https://tvl.ctvba.org.tw/robots.txt
Domain IPs 104.21.14.135, 172.67.159.47, 2606:4700:3032::6815:e87, 2606:4700:3035::ac43:9f2f
Response IP 172.67.159.47
Found Yes
Hash c49e71377e0f06e44ca1f65a6a7d18df8b7bdda60f0fa0f2d71222b32b0e8903
SimHash 6c04dc55c2b9

Groups

*

Rule Path
Allow /news-detail/
Allow /photo/
Allow /team/
Allow /player/
Allow /standing/
Allow /schedule/
Allow /$
Allow /sitemap.xml
Disallow /admin/
Disallow /cart-step*/
Disallow /my-order*/
Disallow /order-*/
Disallow /signin/
Disallow /shop-cart/
Disallow /checkout/
Disallow /*.php$
Disallow /*.js$
Disallow /*.css$
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/

ahrefsbot

Rule Path
Allow /news-detail/
Allow /photo/
Disallow /

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Allow /news-detail/
Allow /photo/
Allow /team/
Allow /player/
Disallow /

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Allow /news-detail/
Allow /photo/
Allow /team/
Allow /player/
Disallow /

Other Records

Field Value
crawl-delay 5

imagesiftbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

googlebot-image

Rule Path
Allow /photo/
Allow /upload/album_photo/
Disallow /

bingbot-image

Rule Path
Allow /photo/
Allow /upload/album_photo/
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://tvl.ctvba.org.tw/sitemap.xml

Comments

  • å
  • å
  • 禁止存取
  • 特定爬蟲的規則
  • 完å
  • 圖片爬蟲特別規則
  • 爬蟲速率限制建議
  • Sitemap 位置

Warnings

  • 3 invalid lines.