Log In Sign Up

novfishing.ru
robots.txt

Robots Exclusion Standard data for novfishing.ru

Resource Scan

Scan Details

Site Domain novfishing.ru
Base Domain novfishing.ru
Scan Status Ok
Last Scan2024-11-08T13:40:09+00:00
Next Scan 2024-11-22T13:40:09+00:00

Last Scan

Scanned2024-11-08T13:40:09+00:00
URL https://novfishing.ru/robots.txt
Domain IPs 178.250.156.24
Response IP 178.250.156.24
Found Yes
Hash 2d33c005ccae9eda129c9b10e52c7e55b9d61aeacbce85404679bad459893f8b
SimHash 623188134d98

Groups

*

Rule Path
Disallow /admin/
Disallow /cache/
Disallow /converge_local/
Disallow /hooks/
Disallow /ips_kernel/
Disallow /retail/
Disallow /public/style_captcha/
Disallow /index.php?app=core&module=task
Disallow /index.php?app=forums&module=moderate&section=moderate
Disallow /index.php?app=forums&module=extras&section=forward
Disallow /index.php?app=members&module=chat
Disallow /index.php?&unlockUserAgent=1
Disallow /*%26module%3Dsearch
Allow /*%26search_tags%3D
Disallow /*app%3Dcore%26module%3Dglobal%26section%3Dreputation
Disallow /*app%3Dcore%26module%3Dusercp
Disallow /*app%3Dmembers%26module%3Dmessaging
Disallow /admincenter/
Disallow /*%26p%3D
Disallow /*%26pid%3D
Disallow /*%26hl%3D
Disallow /*%26start%3D
Disallow /*view__getnewpost$
Disallow /*view__getlastpost$
Disallow /*view__old$
Disallow /*view__new$
Disallow /*view__getfirst$
Disallow /*view__getprevious$
Disallow /*view__getnext$
Disallow /*view__getlast$
Disallow /*%26view%3Dgetnewpost$
Disallow /*%26view%3Dgetlastpost$
Disallow /*%26view%3Dold$
Disallow /*%26view%3Dnew$
Disallow /*%26view%3Dgetfirst$
Disallow /*%26view%3Dgetprevious$
Disallow /*%26view%3Dgetnext$
Disallow /*%26view%3Dgetlast$
Disallow /*?s=
Disallow /*%26s%3D
Disallow /index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /index.php?app=forums&module=extras&section=rating
Disallow /index.php?app=forums&module=forums&section=markasread
Disallow /*%26do%3Dwho
Disallow /*%26section%3Ddname

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://novfishing.ru/sitemap.php
Back to top

Comments

  • HOW TO USE THIS FILE:
  • 1) Edit this file to change " /" to the correct relative path from your base URL, for example if your forum was at "domain.com/sites/community", then you'd use "/sites/community/"
  • 2) Rename the file to 'robots.txt' and move it to your web root (public_html, www, or htdocs)
  • 3) Edit the file to remove this comment (anything above the dashed line, including the dashed line
  • NOTES:
  • Even though wild cards and pattern matching are not part of the robots.txt specification, many search bots understand and make use of them
  • ------------------------ REMOVE THIS LINE AND EVERYTHING ABOVE SO THAT User-agent: * IS THE FIRST LINE ------------------------------------------
Back to top

Warnings

  • `host` is not a known field.
Back to top