thetruckersreport.com
robots.txt

Robots Exclusion Standard data for thetruckersreport.com

Resource Scan

Scan Details

Site Domain thetruckersreport.com
Base Domain thetruckersreport.com
Scan Status Ok
Last Scan2024-11-15T12:26:28+00:00
Next Scan 2024-11-22T12:26:28+00:00

Last Scan

Scanned2024-11-15T12:26:28+00:00
URL https://thetruckersreport.com/robots.txt
Redirect https://www.thetruckersreport.com/robots.txt
Redirect Domain www.thetruckersreport.com
Redirect Base thetruckersreport.com
Domain IPs 198.58.115.138
Redirect IPs 198.58.115.138
Response IP 198.58.115.138
Found Yes
Hash 04d406115ebc36a18aa7d06f21a6444456f305e336baf1bd6e293f8df306f667
SimHash a3c59300c771

Groups

*

Rule Path
Disallow /*?p=
Disallow /*?ua=
Disallow /*?oa=
Disallow /*?sid=
Disallow /*?nojs=
Disallow /*?vbseourl=
Disallow /*?do=ad&id=
Disallow /*?do=category&categoryid=
Disallow /*?do=user&userid=
Disallow /*?do=search&memberid=
Disallow /music/
Disallow /wmamusic/
Disallow /truckinglinks2/rate.php
Disallow /truckingindustryforum/ajax.php
Disallow /truckingindustryforum/attachment.php
Disallow /truckingindustryforum/calendar.php
Disallow /truckingindustryforum/cron.php
Disallow /truckingindustryforum/editpost.php
Disallow /truckingindustryforum/external.php
Disallow /truckingindustryforum/faq.php
Disallow /truckingindustryforum/global.php
Disallow /truckingindustryforum/image.php
Disallow /truckingindustryforum/inlinemod.php
Disallow /truckingindustryforum/joinrequests.php
Disallow /truckingindustryforum/login.php
Disallow /truckingindustryforum/member.php
Disallow /truckingindustryforum/members/
Disallow /truckingindustryforum/memberlist.php
Disallow /truckingindustryforum/misc.php
Disallow /truckingindustryforum/moderator.php
Disallow /truckingindustryforum/newattachment.php
Disallow /truckingindustryforum/newreply.php
Disallow /truckingindustryforum/newthread.php
Disallow /truckingindustryforum/online.php
Disallow /truckingindustryforum/poll.php
Disallow /truckingindustryforum/postings.php
Disallow /truckingindustryforum/printthread.php
Disallow /truckingindustryforum/private.php
Disallow /truckingindustryforum/profile.php
Disallow /truckingindustryforum/register.php
Disallow /truckingindustryforum/report.php
Disallow /truckingindustryforum/reputation.php
Disallow /truckingindustryforum/search.php
Disallow /truckingindustryforum/sendmessage.php
Disallow /truckingindustryforum/showgroups.php
Disallow /truckingindustryforum/subscription.php
Disallow /truckingindustryforum/threadrate.php
Disallow /truckingindustryforum/usercp.php
Disallow /truckingindustryforum/usernote.php
Disallow /truckingindustryforum/posthistory.php
Disallow /truckingindustryforum/tags/
Disallow /*-print.html

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow

grapeshot

Rule Path
Disallow /

Comments

  • robots file for www.TheTruckersReport.com
  • Global Trucker Removal
  • Other Problems
  • vbClassified Removal
  • Normal Site Files/Folders
  • After 3.7.2
  • Yahoo
  • Majestic
  • Grapeshot