shroomery.org
robots.txt
Robots Exclusion Standard data for shroomery.org
Resource Scan
Scan Details
| Site Domain | shroomery.org |
| Base Domain | shroomery.org |
| Scan Status | Ok |
| Last Scan | 2024-06-03T11:53:33+00:00 |
| Next Scan | 2024-06-17T11:53:33+00:00 |
Last Scan
| Scanned | 2024-06-03T11:53:33+00:00 |
| URL | https://shroomery.org/robots.txt |
| Redirect | https://www.shroomery.org/robots.txt |
| Redirect Domain | www.shroomery.org |
| Redirect Base | shroomery.org |
| Domain IPs | 104.27.205.87, 104.27.206.87, 2606:4700:21::681b:cd57, 2606:4700:21::681b:ce57 |
| Redirect IPs | 104.27.205.87, 104.27.206.87, 2606:4700:21::681b:cd57, 2606:4700:21::681b:ce57 |
| Response IP | 104.27.205.87 |
| Found | Yes |
| Hash | c3d7f1e3c9cfc9160bd93850f05661b68950c6dbec68ea39b3f36df5c208ef99 |
| SimHash | 7a1e494758f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.asp$ |
| Disallow | /_oldscripts/ |
| Disallow | /admin/ |
| Disallow | /amanita.php |
| Disallow | /archives/ |
| Disallow | /bluethumb/ |
| Disallow | /cgi-bin/ |
| Disallow | /chinacat/ |
| Disallow | /cms/ |
| Disallow | /comment.php |
| Disallow | /dbtest/ |
| Disallow | /donations/ |
| Disallow | /dosageandingestion.php |
| Disallow | /email.php |
| Disallow | /faq/ |
| Disallow | /findorgrowthem.php |
| Disallow | /fom/ |
| Disallow | /forums/addpost.php |
| Disallow | /forums/admin/ |
| Disallow | /forums/archive/ |
| Disallow | /forums/calendar.php |
| Disallow | /forums/dosearch.php |
| Disallow | /forums/download.php |
| Disallow | /forums/feed.php |
| Disallow | /forums/fom-* |
| Disallow | /forums/grabnext.php |
| Disallow | /forums/includes/fah.php |
| Disallow | /forums/invite-access.php |
| Disallow | /forums/login.php |
| Disallow | /forums/newpost.php |
| Disallow | /forums/newrating.php |
| Disallow | /forums/newreply.php |
| Disallow | /forums/online.php |
| Disallow | /forums/percent.php |
| Disallow | /forums/postlist.php*expanded |
| Disallow | /forums/postlocations.php |
| Disallow | /forums/printthread.php |
| Disallow | /forums/rate/ |
| Disallow | /forums/ratingoptout.php |
| Disallow | /forums/sendprivate.php |
| Disallow | /forums/showflat-Number- |
| Disallow | /forums/showflat.php/*/filter/ |
| Disallow | /forums/showmembers.php*like%3D |
| Disallow | /forums/showprofile.php |
| Disallow | /forums/showthreaded.php |
| Disallow | /forums/smileypanel.php |
| Disallow | /forums/threadstats.php |
| Disallow | /forums/usergallery.php/*/imgpl/ |
| Disallow | /forums/usergallery.php/*/imgpp/ |
| Disallow | /forums/viewratings.php?*sort= |
| Disallow | /gallery.php |
| Disallow | /generalinfo.php |
| Disallow | /glossary/ |
| Disallow | /glossary2/ |
| Disallow | /glossary2? |
| Disallow | /glossary? |
| Disallow | /hp/ |
| Disallow | |
| Disallow | /index/sty/print |
| Disallow | /links/ |
| Disallow | /matts/ |
| Disallow | /mjshroomer/ |
| Disallow | /mobile/ |
| Disallow | /news.php |
| Disallow | /pharmacology.php |
| Disallow | /pubssl/ |
| Disallow | /robotstats/ |
| Disallow | /scgt/ |
| Disallow | /search.php |
| Disallow | /ssoogle/ |
| Disallow | /store/ |
| Disallow | /supporters/ |
| Disallow | /tripreports.php |
| Disallow | /triptoysandsuggestions.php |
| Disallow | /ubbcgi/ |
| Disallow | /ubbnoncgi/ |
| Disallow | /wiki/ |
| Disallow | /wwwthreads/ |
| Disallow | /~ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.shroomery.org/www.shroomery.org.sslsitemap.xml |
Warnings
- `clean-param` is not a known field.