kobiwebajans.com
robots.txt

Robots Exclusion Standard data for kobiwebajans.com

Resource Scan

Scan Details

Site Domain kobiwebajans.com
Base Domain kobiwebajans.com
Scan Status Ok
Last Scan2024-09-07T23:38:38+00:00
Next Scan 2024-10-07T23:38:38+00:00

Last Scan

Scanned2024-09-07T23:38:38+00:00
URL https://kobiwebajans.com/robots.txt
Domain IPs 2a06:41c0:1:f::1d1, 89.252.182.35
Response IP 89.252.182.35
Found Yes
Hash 22a734f3c47197f9a9614f619f9edaf51ab0fdb0b00fda68289da3b5bbe7ba73
SimHash 24351b04d7b5

Groups

msnbot
googlebot
mediapartners-google*
yandex
googlebot-mobile
google-sitemaps/
googlebot-image
scooter
ask jeeves
feedfetcher-google
yahoo-verticalcrawler
mmcrawler
yahoo! slurp
yahoo-blogs
yahoofeedseeker
snap
msmobot
google wireless transcoder
feedburner
*

Rule Path
Disallow /cgi-bin
Disallow /admin
Disallow /ESK%C3%9D
Disallow /skins
Disallow /system
Disallow /message.php
Disallow /js