1469635693.rsc.cdn77.org
robots.txt
Robots Exclusion Standard data for 1469635693.rsc.cdn77.org
Resource Scan
Scan Details
Site Domain | 1469635693.rsc.cdn77.org |
Base Domain | 1469635693.rsc.cdn77.org |
Scan Status | Ok |
Last Scan | 2024-07-02T18:34:13+00:00 |
Next Scan | 2024-07-09T18:34:13+00:00 |
Last Scan
Scanned | 2024-07-02T18:34:13+00:00 |
URL | https://1469635693.rsc.cdn77.org/robots.txt |
Domain IPs | 2a02:6ea0:d100::32, 2a02:6ea0:d100::33, 2a02:6ea0:d100::34, 2a02:6ea0:d100::35, 2a02:6ea0:d100::36, 79.127.213.228, 79.127.235.11, 79.127.235.3, 79.127.235.6, 79.127.235.9 |
Response IP | 79.127.235.6 |
Found | Yes |
Hash | 5407fdbbeb4ff008de7cabf2d11851614a1f4f2466fc7b36e54e02368663183a |
SimHash | 3e73eaa25eab |
Groups
mediapartners-google
googlebot-mobile
googlebot
teoma
slurp
yandex
baiduspider
naverbot
yeti
yandex
bingbot
applebot
facebookexternalhit
Rule | Path |
---|---|
Disallow | /test/ |
Disallow | /account/ |
Disallow | /admin.php |
Disallow | /ajax/ |
Disallow | /conversations/ |
Disallow | /events/birthdays/ |
Disallow | /events/monthly |
Disallow | /events/weekly |
Disallow | /find-new/ |
Disallow | /forums/-/ |
Disallow | /forums/tweets/ |
Disallow | /goto/ |
Disallow | /help/ |
Disallow | /login/ |
Disallow | /lost-password/ |
Disallow | /media/category/ |
Disallow | /media/keyword/ |
Disallow | /media/user/ |
Disallow | /media/service/ |
Disallow | /media/submit/ |
Disallow | /misc/style?* |
Disallow | /misc/quick-navigation-menu?* |
Disallow | /online/ |
Disallow | /pages/conduct/ |
Disallow | /pages/privacy/ |
Disallow | /posts/ |
Disallow | /threads/tera-tweet-from-* |
Disallow | /wiki/special/ |
Disallow | /forums/*?order= |
Disallow | /members/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
*
Rule | Path |
---|---|
Disallow | / |
Comments