wble-kpr.utar.edu.my
robots.txt

Robots Exclusion Standard data for wble-kpr.utar.edu.my

Resource Scan

Scan Details

Site Domain wble-kpr.utar.edu.my
Base Domain utar.edu.my
Scan Status Ok
Last Scan2024-11-03T09:46:51+00:00
Next Scan 2024-12-03T09:46:51+00:00

Last Scan

Scanned2024-11-03T09:46:51+00:00
URL https://wble-kpr.utar.edu.my/robots.txt
Domain IPs 121.123.29.131
Response IP 121.123.29.131
Found Yes
Hash 55ce10ff5bb08b79e344149478a5380063bdf9e6b5dd0d2389ecd43efb4bfa23
SimHash 2c1efa6183f7

Groups

googlebot
google
bingbot
bing
yahoo! slurp
baiduspider
baiduspider-image
yandexbot
yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

*

Rule Path
Disallow /