Log In Sign Up

www.ru.dinoera.com
robots.txt

Robots Exclusion Standard data for www.ru.dinoera.com

Resource Scan

Scan Details

Site Domain www.ru.dinoera.com
Base Domain dinoera.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-14T09:10:58+00:00
Next Scan 2025-12-13T09:10:58+00:00

Last Successful Scan

Scanned2025-07-24T05:57:50+00:00
URL https://www.ru.dinoera.com/robots.txt
Domain IPs 31.131.27.85
Response IP 31.131.27.85
Found Yes
Hash 52f660965d8297013b218c8fb8856141221eba403f9c7df80f96af4cddca27ff
SimHash 3a9415094754

Groups

*

Rule Path
Allow /includes/
Allow /misc/
Allow /modules/
Allow /profiles/
Allow /scripts/
Allow /themes/
Allow /CHANGELOG.txt
Allow /cron.php
Allow /INSTALL.mysql.txt
Allow /INSTALL.pgsql.txt
Allow /INSTALL.sqlite.txt
Allow /install.php
Allow /INSTALL.txt
Allow /LICENSE.txt
Allow /MAINTAINERS.txt
Allow /update.php
Allow /UPGRADE.txt
Allow /xmlrpc.php
Allow /admin/
Allow /comment/reply/
Allow /filter/tips/
Allow /node/add/
Allow /search/
Allow /user/register/
Allow /user/password/
Allow /user/login/
Allow /user/logout/
Allow /?q=admin%2F
Allow /?q=comment%2Freply%2F
Allow /?q=filter%2Ftips%2F
Allow /?q=node%2Fadd%2F
Allow /?q=search%2F
Allow /?q=user%2Fpassword%2F
Allow /?q=user%2Fregister%2F
Allow /?q=user%2Flogin%2F
Allow /?q=user%2Flogout%2F

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /8ulzgyl6

bingbot
googlebot
slurp

Rule Path
Allow

*

Rule Path
Allow /lebanese-civil-btdu

bingbot
googlebot
slurp

Rule Path
Allow

*

Rule Path
Allow /hwb6t1

bingbot
googlebot
slurp

Rule Path
Allow

*

Rule Path
Allow /josephine-philby-lkdqnhs

bingbot
googlebot
slurp

Rule Path
Allow

*

Rule Path
Allow /pickup-on-tgbhwe

bingbot
googlebot
slurp

Rule Path
Allow
Back to top

Other Records

Field Value
sitemap http://dinoera.com/8ulzgyl6/sitemap.xml
sitemap http://dinoera.com/lebanese-civil-btdu/sitemap.xml
sitemap http://dinoera.com/hwb6t1/sitemap.xml
sitemap http://dinoera.com/josephine-philby-lkdqnhs/sitemap.xml
sitemap http://dinoera.com/pickup-on-tgbhwe/sitemap.xml
Back to top

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • For syntax checking, see:
  • http://www.frobee.com/robots-txt-check
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
Back to top