kobiwebajans.com
robots.txt
Robots Exclusion Standard data for kobiwebajans.com
Resource Scan
Scan Details
Site Domain | kobiwebajans.com |
Base Domain | kobiwebajans.com |
Scan Status | Ok |
Last Scan | 2024-09-07T23:38:38+00:00 |
Next Scan | 2024-10-07T23:38:38+00:00 |
Last Scan
Scanned | 2024-09-07T23:38:38+00:00 |
URL | https://kobiwebajans.com/robots.txt |
Domain IPs | 2a06:41c0:1:f::1d1, 89.252.182.35 |
Response IP | 89.252.182.35 |
Found | Yes |
Hash | 22a734f3c47197f9a9614f619f9edaf51ab0fdb0b00fda68289da3b5bbe7ba73 |
SimHash | 24351b04d7b5 |
Groups
msnbot
googlebot
mediapartners-google*
yandex
googlebot-mobile
google-sitemaps/
googlebot-image
scooter
ask jeeves
feedfetcher-google
yahoo-verticalcrawler
mmcrawler
yahoo! slurp
yahoo-blogs
yahoofeedseeker
snap
msmobot
google wireless transcoder
feedburner
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /admin |
Disallow | /ESK%C3%9D |
Disallow | /skins |
Disallow | /system |
Disallow | /message.php |
Disallow | /js |