ntd24.tw
robots.txt

Robots Exclusion Standard data for ntd24.tw

Resource Scan

Scan Details

Site Domain ntd24.tw
Base Domain ntd24.tw
Scan Status Ok
Last Scan2024-09-28T13:01:34+00:00
Next Scan 2024-10-05T13:01:34+00:00

Last Scan

Scanned2024-09-28T13:01:34+00:00
URL https://ntd24.tw/robots.txt
Redirect https://www.ntd24.tw/robots.txt
Redirect Domain www.ntd24.tw
Redirect Base ntd24.tw
Domain IPs 104.21.69.204, 172.67.213.20, 2606:4700:3030::ac43:d514, 2606:4700:3031::6815:45cc
Redirect IPs 104.21.69.204, 172.67.213.20, 2606:4700:3030::ac43:d514, 2606:4700:3031::6815:45cc
Response IP 172.67.213.20
Found Yes
Hash 6c61c9c37752c7195b41c056f57e125bb65fd49e897d28f35613f0fe67864ad6
SimHash 9a3c45426e99

Groups

mj12bot
semrushbot-sa
semrushbot
ahrefsbot
dotbot
mauibot
mauibot (crawler.feedback+wc@gmail.com)
megaindex.ru/2.0
seekport crawler
sputnikbot/2.3
the knowledge ai
turnitinbot
ucbrowser
yacybot
yeti
seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /