shroomery.org
robots.txt

Robots Exclusion Standard data for shroomery.org

Resource Scan

Scan Details

Site Domain shroomery.org
Base Domain shroomery.org
Scan Status Ok
Last Scan2024-10-21T12:06:24+00:00
Next Scan 2024-11-04T12:06:24+00:00

Last Scan

Scanned2024-10-21T12:06:24+00:00
URL https://shroomery.org/robots.txt
Redirect https://www.shroomery.org/robots.txt
Redirect Domain www.shroomery.org
Redirect Base shroomery.org
Domain IPs 104.27.205.87, 104.27.206.87, 2606:4700:21::681b:cd57, 2606:4700:21::681b:ce57
Redirect IPs 104.27.205.87, 104.27.206.87, 2606:4700:21::681b:cd57, 2606:4700:21::681b:ce57
Response IP 104.27.206.87
Found Yes
Hash 7d9c79589781408db66eb9e6866864a3b0bffadc4abc231602503f2763149ce1
SimHash 7a0e494758a3

Groups

adsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bluechipbacklinks

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

riddler

Rule Path
Disallow /

sebot-wa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

*

Rule Path
Disallow /*.asp$
Disallow /_oldscripts/
Disallow /admin/
Disallow /amanita.php
Disallow /archives/
Disallow /bluethumb/
Disallow /cgi-bin/
Disallow /chinacat/
Disallow /cms/
Disallow /comment.php
Disallow /dbtest/
Disallow /donations/
Disallow /dosageandingestion.php
Disallow /email.php
Disallow /faq/
Disallow /findorgrowthem.php
Disallow /fom/
Disallow /forums/addpost.php
Disallow /forums/admin/
Disallow /forums/archive/
Disallow /forums/banomatic.php
Disallow /forums/calendar.php
Disallow /forums/dosearch.php
Disallow /forums/download.php
Disallow /forums/editbasic.php
Disallow /forums/editdisplay.php
Disallow /forums/favlinker.php
Disallow /forums/feed.php
Disallow /forums/fom-*
Disallow /forums/grabnext.php
Disallow /forums/includes/fah.php
Disallow /forums/invite-access.php
Disallow /forums/newpost.php
Disallow /forums/newrating.php
Disallow /forums/newreply.php
Disallow /forums/online.php
Disallow /forums/percent.php
Disallow /forums/postlist.php*expanded
Disallow /forums/postlocations.php
Disallow /forums/pmlists.php
Disallow /forums/printthread.php
Disallow /forums/rate/
Disallow /forums/ratingoptout.php
Disallow /forums/remlinker.php
Disallow /forums/removeaddress.php
Disallow /forums/sendprivate.php
Disallow /forums/showflat-Number-
Disallow /forums/showflat.php/*/filter/
Disallow /forums/showmembers.php*like%3D
Disallow /forums/showprofile.php
Disallow /forums/showthreaded.php
Disallow /forums/smileypanel.php
Disallow /forums/threadstats.php
Disallow /forums/usergallery.php/*/imgpl/
Disallow /forums/usergallery.php/*/imgpp/
Disallow /forums/viewratings.php?*sort=
Disallow /gallery.php
Disallow /generalinfo.php
Disallow /glossary/
Disallow /glossary2/
Disallow /glossary2?
Disallow /glossary?
Disallow /hp/
Disallow /*/print
Disallow /index/sty/print
Disallow /links/
Disallow /matts/
Disallow /mjshroomer/
Disallow /mobile/
Disallow /news.php
Disallow /pharmacology.php
Disallow /pubssl/
Disallow /robotstats/
Disallow /scgt/
Disallow /search.php
Disallow /ssoogle/
Disallow /store/
Disallow /supporters/
Disallow /tripreports.php
Disallow /triptoysandsuggestions.php
Disallow /ubbcgi/
Disallow /ubbnoncgi/
Disallow /wiki/
Disallow /wwwthreads/
Disallow /~

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.shroomery.org/www.shroomery.org.sslsitemap.xml

Warnings

  • `clean-param` is not a known field.