news.tvbs.com.tw
robots.txt

Robots Exclusion Standard data for news.tvbs.com.tw

Resource Scan

Scan Details

Site Domain news.tvbs.com.tw
Base Domain tvbs.com.tw
Scan Status Ok
Last Scan2024-09-20T22:37:18+00:00
Next Scan 2024-09-27T22:37:18+00:00

Last Scan

Scanned2024-09-20T22:37:18+00:00
URL https://news.tvbs.com.tw/robots.txt
Domain IPs 13.35.210.107, 13.35.210.50, 13.35.210.54, 13.35.210.79, 2600:9000:2078:0:7:f502:ad00:93a1, 2600:9000:2078:2a00:7:f502:ad00:93a1, 2600:9000:2078:3600:7:f502:ad00:93a1, 2600:9000:2078:5200:7:f502:ad00:93a1, 2600:9000:2078:7000:7:f502:ad00:93a1, 2600:9000:2078:8200:7:f502:ad00:93a1, 2600:9000:2078:c600:7:f502:ad00:93a1, 2600:9000:2078:e200:7:f502:ad00:93a1
Response IP 13.35.210.50
Found Yes
Hash bf34fa248d212f6abb1962848cbeae45d6738a5262f7d3d9be6e955532488cdf
SimHash 6209f8418721

Groups

*

Rule Path
Disallow /api/recordNewsViewsCount

bingbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://news.tvbs.com.tw/crontab/sitemap/
sitemap https://news.tvbs.com.tw/crontab/sitemap/latest
sitemap https://news.tvbs.com.tw/crontab/sitemap/google