hkd24.hk
robots.txt

Robots Exclusion Standard data for hkd24.hk

Resource Scan

Scan Details

Site Domain hkd24.hk
Base Domain hkd24.hk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-10T18:26:19+00:00
Next Scan 2024-11-09T18:26:19+00:00

Last Successful Scan

Scanned2024-07-13T18:25:23+00:00
URL https://hkd24.hk/robots.txt
Redirect https://www.hkd24.hk/robots.txt
Redirect Domain www.hkd24.hk
Redirect Base hkd24.hk
Domain IPs 104.21.39.199, 172.67.171.88, 2606:4700:3031::6815:27c7, 2606:4700:3034::ac43:ab58
Redirect IPs 104.21.39.199, 172.67.171.88, 2606:4700:3031::6815:27c7, 2606:4700:3034::ac43:ab58
Response IP 172.67.171.88
Found Yes
Hash 6c61c9c37752c7195b41c056f57e125bb65fd49e897d28f35613f0fe67864ad6
SimHash 9a3c45426e99

Groups

mj12bot
semrushbot-sa
semrushbot
ahrefsbot
dotbot
mauibot
mauibot (crawler.feedback+wc@gmail.com)
megaindex.ru/2.0
seekport crawler
sputnikbot/2.3
the knowledge ai
turnitinbot
ucbrowser
yacybot
yeti
seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /