theturboforums.com
robots.txt

Robots Exclusion Standard data for theturboforums.com

Resource Scan

Scan Details

Site Domain theturboforums.com
Base Domain theturboforums.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-19T07:01:04+00:00
Next Scan 2025-12-18T07:01:04+00:00

Last Successful Scan

Scanned2024-05-28T03:09:15+00:00
URL https://theturboforums.com/robots.txt
Domain IPs 104.21.76.247, 172.67.202.128, 2606:4700:3031::6815:4cf7, 2606:4700:3037::ac43:ca80
Response IP 104.21.76.247
Found Yes
Hash 3114c058b9c31276eea9a1c72fcd397c252ce5681bf98dc38c90a937a67e44d1
SimHash 603753614d45

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow
Allow /

mediapartners-google

Rule Path
Disallow /hp/
Disallow /hp/separationdetective.php

bingbot

Rule Path
Disallow
Allow /

mediapartners-google

Rule Path
Disallow /hp/
Disallow /hp/separationdetective.php

slurp

Rule Path
Disallow
Allow /

mediapartners-google

Rule Path
Disallow /hp/
Disallow /hp/separationdetective.php

msnbot

Rule Path
Disallow
Allow /

mediapartners-google

Rule Path
Disallow /hp/
Disallow /hp/separationdetective.php

applebot

Rule Path
Disallow /admincp/
Disallow /backup/
Disallow /blogs/
Disallow /blog.php
Disallow /calendar.php
Disallow /clientscript/
Disallow /converse.php
Disallow /cron.php
Disallow /css.php
Disallow /director.php
Disallow /dynamics/dynamics/
Disallow /errors.php
Disallow /external.php
Disallow /feed/
Disallow /forms.php
Disallow /forums/222-Test-Area
Disallow /forums/239-After-Dark
Disallow /help/
Disallow /forums/misc/
Disallow /forums/help/
Disallow /forums/media/
Disallow /history/
Disallow /hp/
Disallow /images/
Disallow /list/
Disallow /login.php
Disallow /lost-password/
Disallow /media/u*
Disallow /media.php?do=rss*
Disallow /members/
Disallow /media/help/
Disallow /media/members/
Disallow /media/misc/
Disallow /misc.php
Disallow /misc/
Disallow /mobiquo/
Disallow /moderator.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /payments.php
Disallow /pictures/plog-rss.php
Disallow /printthread.php
Disallow /private.php
Disallow /projhp/
Disallow /proxy.php?link
Disallow /register.php
Disallow /report.php
Disallow /search/
Disallow /search.php
Disallow /sendmessage.php
Disallow /smf/*?action=post
Disallow /smf/*?action=trader
Disallow /smf/*area%3Dshowposts
Disallow /smf/dlattach/
Disallow /smf/images/
Disallow /smf/Images/
Disallow /smf/index.php?action=pm*
Disallow /smf/index.php?action=admin*
Disallow /smf/index.php?action=calendar*
Disallow /smf/index.php?action=login*
Disallow /smf/index.php?action=printpage*
Disallow /smf/index.php?action=profile*
Disallow /smf/index.php?action=register*
Disallow /smf/index.php?action=search*
Disallow /smf/index.php?action=stats*
Disallow /smf/index.php?*rss*
Disallow /smf/index.php?wwwRedirect*
Disallow /smf/pic2/
Disallow /smf/Smileys/
Disallow /smf/Sources/
Disallow /smf/Themes/
Disallow /smf/wallpapers/
Disallow /smf/.xml/
Disallow /subscription.php
Disallow /threadloom
Disallow /trapbot/
Disallow /treeview/
Disallow /visitme/
Disallow /forumdisplay.php?do=markread*
Disallow /projectcar/Supra/forsale/
Disallow /itrader_user.php
Disallow /login.php
Disallow /hp/
Disallow /hp/separationdetective.php
Disallow /tags/

mediapartners-google

Rule Path
Disallow /hp/
Disallow /hp/separationdetective.php

Comments

  • robots.txt for http://theturboforums.com/
  • generated by robots.php VERSION
  • All hits are logged. If your crawler isn't a search engine or other service
  • that will bring us traffic or benefit us, its not welcome here.
  • We do not allow non-authorized robots. Any unauthorized bot running on our
  • will have its IP(s) banned. Honey pots are running.
  • Showcontents 1
  • Mozilla/5.0 (compatible; WellKnownBot/0.1; +https://well-known.dev/about/#bot)
  • restrict all access 2