Log In Sign Up

riotpixels.com
robots.txt

Robots Exclusion Standard data for riotpixels.com

Resource Scan

Scan Details

Site Domain riotpixels.com
Base Domain riotpixels.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-20T06:59:33+00:00
Next Scan 2024-10-04T06:59:33+00:00

Last Successful Scan

Scanned2024-09-04T20:53:25+00:00
URL https://riotpixels.com/robots.txt
Domain IPs 104.21.19.78, 172.67.185.167, 2606:4700:3036::6815:134e, 2606:4700:3037::ac43:b9a7
Response IP 104.21.19.78
Found Yes
Hash 13d0865fb6654ab0844932a45ca6bf4ccf5e3df1bea4969a2b46c73eb6e3e74b
SimHash a810804b0d52

Groups

*

Rule Path
Disallow /forums_test/*
Disallow /forums/admin/
Disallow /forums/cache/
Disallow /forums/converge_local/
Disallow /forums/hooks/
Disallow /forums/ips_kernel/
Disallow /forums/retail/
Disallow /forums/public/style_captcha/
Disallow /forums/index.php?app=core&module=task
Disallow /forums/index.php?app=forums&module=moderate&section=moderate
Disallow /forums/index.php?app=forums&module=extras&section=forward
Disallow /forums/index.php?app=members&module=chat
Disallow /forums/index.php?&unlockUserAgent=1
Disallow /forums/*%26module%3Dsearch
Disallow /forums/*app%3Dcore%26module%3Dglobal%26section%3Dreputation
Disallow /forums/*app%3Dcore%26module%3Dusercp
Disallow /forums/*app%3Dmembers%26module%3Dmessaging
Disallow /forums/*%26p%3D
Disallow /forums/*%26pid%3D
Disallow /forums/*%26hl%3D
Disallow /forums/*%26start%3D
Disallow /forums/*view__getnewpost$
Disallow /forums/*view__getlastpost$
Disallow /forums/*view__old$
Disallow /forums/*view__new$
Disallow /forums/*view__getfirst$
Disallow /forums/*view__getprevious$
Disallow /forums/*view__getnext$
Disallow /forums/*view__getlast$
Disallow /forums/*%26view%3Dgetnewpost$
Disallow /forums/*%26view%3Dgetlastpost$
Disallow /forums/*%26view%3Dold$
Disallow /forums/*%26view%3Dnew$
Disallow /forums/*%26view%3Dgetfirst$
Disallow /forums/*%26view%3Dgetprevious$
Disallow /forums/*%26view%3Dgetnext$
Disallow /forums/*%26view%3Dgetlast$
Disallow /forums/*?s=
Disallow /forums/*%26s%3D
Disallow /forums/index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /forums/index.php?app=forums&module=extras&section=rating
Disallow /forums/index.php?app=forums&module=forums&section=markasread
Disallow /forums/*%26do%3Dwho
Disallow /forums/*%26section%3Ddname

Other Records

Field Value
crawl-delay 20

xovibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • HOW TO USE THIS FILE:
  • 1) Edit this file to change "/forum/" to the correct relative path from your base URL, for example if your forum was at "domain.com/sites/community", then you'd use "/sites/community/"
  • 2) Rename the file to 'robots.txt' and move it to your web root (public_html, www, or htdocs)
  • 3) Edit the file to remove this comment (anything above the dashed line, including the dashed line
  • NOTES:
  • Even though wild cards and pattern matching are not part of the robots.txt specification, many search bots understand and make use of them
  • ------------------------ REMOVE THIS LINE AND EVERYTHING ABOVE SO THAT User-agent: * IS THE FIRST LINE ------------------------------------------
Back to top