Log In Sign Up

darkside.ru
robots.txt

Robots Exclusion Standard data for darkside.ru

Resource Scan

Scan Details

Site Domain darkside.ru
Base Domain darkside.ru
Scan Status Ok
Last Scan2024-09-20T18:30:17+00:00
Next Scan 2024-09-27T18:30:17+00:00

Last Scan

Scanned2024-09-20T18:30:17+00:00
URL https://darkside.ru/robots.txt
Domain IPs 91.232.134.154
Response IP 91.232.134.154
Found Yes
Hash 70435833e0261d1b1f3377e0ff774afb272b4d10921d5ce0e345844cda658cff
SimHash a442d88eeea2

Groups

*

No rules defined. All paths allowed.

Back to top

Comments

  • Disallow: /forum/search.php
  • Disallow: /forum/ucp.php
  • Disallow: /forum/memberlist.php
  • Disallow: /news/search.phtml
  • Disallow: /bands/bandadd.phtml
  • Disallow: /bands/albumadd.phtml
  • Disallow: /user/
  • Disallow: /blog/
  • Disallow: /reviews/search-result.phtml
  • Disallow: /search/
  • Crawl-delay: 2
Back to top

Warnings

  • `host` is not a known field.
Back to top