Log In Sign Up

utopia.sk
robots.txt

Robots Exclusion Standard data for utopia.sk

Resource Scan

Scan Details

Site Domain utopia.sk
Base Domain utopia.sk
Scan Status Ok
Last Scan2024-09-12T09:49:16+00:00
Next Scan 2024-10-12T09:49:16+00:00

Last Scan

Scanned2024-09-12T09:49:16+00:00
URL https://utopia.sk/robots.txt
Domain IPs 109.74.145.94
Response IP 109.74.145.94
Found Yes
Hash 9358063aef2a0af654f2e53912640520fb3215965472875850d946913ec2de6d
SimHash 9a109ec2e221

Groups

*

Rule Path
Disallow /*calendar*
Disallow /*login*forgot_passwor
Disallow /*create_account
Disallow /*open_id
Disallow /*search

bingbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sogou

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

mozilla/5.0 (compatible; blexbot/1.0; +http://webmeup-crawler.com/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/5.2; +http://ahrefs.com/robot/)

Rule Path
Disallow /

bubing (+http://law.di.unimi.it/bubing.html

Product Comment
bubing (+http://law.di.unimi.it/bubing.html wc)
Rule Path
Disallow /

sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /
Back to top

Comments

  • Disallow: /*struts_action=%2Fcalendar
  • Disallow: /*struts_action=%2Flogin%2Fforgot_password
  • Disallow: /*struts_action=%2Flogin%2Fcreate_account
  • Disallow: /*struts_action=%2Flogin%2Fopen_id
  • Disallow: /*struts_action=%2Fsearch%2Fsearch
Back to top