Log In Sign Up

cashtor.org
robots.txt

Robots Exclusion Standard data for cashtor.org

Resource Scan

Scan Details

Site Domain cashtor.org
Base Domain cashtor.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-03-07T05:54:30+00:00
Next Scan 2024-06-05T05:54:30+00:00

Last Successful Scan

Scanned2023-07-19T00:11:20+00:00
URL https://cashtor.org/robots.txt
Domain IPs 104.21.28.184, 172.67.147.22, 2606:4700:3032::ac43:9316, 2606:4700:3036::6815:1cb8
Response IP 104.21.28.184
Found Yes
Hash 9ce8138728b0108e68b2b09481db4adfdab685cc6cd09304d381c970c5af3b40
SimHash 6a14a0114954

Groups

*

Rule Path
Disallow /forum/admin/
Disallow /forum/cache/
Disallow /forum/converge_local/
Disallow /forum/hooks/
Disallow /forum/ips_kernel/
Disallow /forum/retail/
Disallow /forum/public/style_captcha/
Disallow /forum/index.php?app=core&module=task
Disallow /forum/index.php?app=forums&module=moderate&section=moderate
Disallow /forum/index.php?app=forums&module=extras&section=forward
Disallow /forum/index.php?app=members&module=chat
Disallow /forum/index.php?&unlockUserAgent=1
Disallow /forum/*%26module%3Dsearch
Allow /forum/*%26search_tags%3D
Disallow /forum/*app%3Dcore%26module%3Dglobal%26section%3Dreputation
Disallow /forum/*app%3Dcore%26module%3Dusercp
Disallow /forum/*app%3Dmembers%26module%3Dmessaging
Disallow /forum/*%26p%3D
Disallow /forum/*%26pid%3D
Disallow /forum/*%26hl%3D
Disallow /forum/*%26start%3D
Disallow /forum/*view__getnewpost$
Disallow /forum/*view__getlastpost$
Disallow /forum/*view__old$
Disallow /forum/*view__new$
Disallow /forum/*view__getfirst$
Disallow /forum/*view__getprevious$
Disallow /forum/*view__getnext$
Disallow /forum/*view__getlast$
Disallow /forum/*%26view%3Dgetnewpost$
Disallow /forum/*%26view%3Dgetlastpost$
Disallow /forum/*%26view%3Dold$
Disallow /forum/*%26view%3Dnew$
Disallow /forum/*%26view%3Dgetfirst$
Disallow /forum/*%26view%3Dgetprevious$
Disallow /forum/*%26view%3Dgetnext$
Disallow /forum/*%26view%3Dgetlast$
Disallow /forum/*?s=
Disallow /forum/*%26s%3D
Disallow /forum/index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /forum/index.php?app=forums&module=extras&section=rating
Disallow /forum/index.php?app=forums&module=forums&section=markasread
Disallow /forum/*%26do%3Dwho
Disallow /forum/*%26section%3Ddname

yandex

Rule Path
Allow *

google

Rule Path
Allow *

googlebot

Rule Path
Allow *
Back to top

Other Records

Field Value
sitemap https://cashtor.org/sitemap.xml
Back to top

Comments

  • HOW TO USE THIS FILE:
  • 1) Edit this file to change "/forum/" to the correct relative path from your base URL, for example if your forum was at "domain.com/sites/community", then you'd use "/sites/community/"
  • 2) Rename the file to 'robots.txt' and move it to your web root (public_html, www, or htdocs)
  • 3) Edit the file to remove this comment (anything above the dashed line, including the dashed line
  • NOTES:
  • Even though wild cards and pattern matching are not part of the robots.txt specification, many search bots understand and make use of them
  • ------------------------ REMOVE THIS LINE AND EVERYTHING ABOVE SO THAT User-agent: * IS THE FIRST LINE ------------------------------------------
Back to top

Warnings

  • `host` is not a known field.
Back to top