Log In Sign Up

rur.rs
robots.txt

Robots Exclusion Standard data for rur.rs

Resource Scan

Scan Details

Site Domain rur.rs
Base Domain rur.rs
Scan Status Ok
Last Scan2025-12-06T06:44:33+00:00
Next Scan 2025-12-13T06:44:33+00:00

Last Scan

Scanned2025-12-06T06:44:33+00:00
URL https://rur.rs/robots.txt
Domain IPs 176.9.48.134
Response IP 176.9.48.134
Found Yes
Hash c77157df31809c1591f44863d20eb3908ad40a943b068ef325a6fba7a06dba5f
SimHash ba141d884d74

Groups

*

Rule Path
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /sites/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /contact/
Disallow /logout/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=contact%2F
Disallow /?q=logout%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /forum/admin/
Disallow /forum/cache/
Disallow /forum/converge_local/
Disallow /forum/hooks/
Disallow /forum/ips_kernel/
Disallow /forum/retail/
Disallow /forum/public/style_captcha/
Disallow /forum/index.php?app=core&module=task
Disallow /forum/index.php?app=forums&module=moderate&section=moderate
Disallow /forum/index.php?app=forums&module=extras&section=forward
Disallow /forum/index.php?app=members&module=messaging
Disallow /forum/index.php?app=members&module=chat
Disallow /forum/index.php?app=members&module=search
Disallow /forum/index.php?app=members&module=search&do=active
Disallow /forum/index.php?&unlockUserAgent=1
Disallow /forum/*app%3Dcore%26module%3Dglobal%26section%3Dreputation
Disallow /forum/*app%3Dcore%26module%3Dusercp
Disallow /forum/*app%3Dcore%26amp%3Bmodule%3Dusercp
Disallow /forum/*app%3Dmembers%26module%3Dmessaging
Disallow /forum/*%26p%3D
Disallow /forum/*%26pid%3D
Disallow /forum/*%26hl%3D
Disallow /forum/*%26start%3D
Disallow /forum/*view__getnewpost$
Disallow /forum/*view__getlastpost$
Disallow /forum/*view__old$
Disallow /forum/*view__new$
Disallow /forum/*view__getfirst$
Disallow /forum/*view__getprevious$
Disallow /forum/*view__getnext$
Disallow /forum/*view__getlast$
Disallow /forum/*%26view%3Dgetnewpost$
Disallow /forum/*%26view%3Dgetlastpost$
Disallow /forum/*%26view%3Dold$
Disallow /forum/*%26view%3Dnew$
Disallow /forum/*%26view%3Dgetfirst$
Disallow /forum/*%26view%3Dgetprevious$
Disallow /forum/*%26view%3Dgetnext$
Disallow /forum/*%26view%3Dgetlast$
Disallow /forum/*?s=
Disallow /forum/*%26s%3D
Disallow /forum/index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /forum/index.php?app=forums&module=extras&section=rating
Disallow /forum/index.php?app=forums&module=forums&section=markasread
Disallow /forum/*%26do%3Dwho
Disallow /forum/*%26section%3Ddname

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /wp-content/cache/
Back to top

Comments

  • $Id: robots.txt,v 1.9.2.1 2008/12/10 20:12:19 goba Exp $
  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • BEGIN W3TC ROBOTS
  • END W3TC ROBOTS
Back to top