Log In Sign Up

transcanadahighway.com
robots.txt

Robots Exclusion Standard data for transcanadahighway.com

Resource Scan

Scan Details

Site Domain transcanadahighway.com
Base Domain transcanadahighway.com
Scan Status Ok
Last Scan2024-06-27T17:53:53+00:00
Next Scan 2024-07-04T17:53:53+00:00

Last Scan

Scanned2024-06-27T17:53:53+00:00
URL https://transcanadahighway.com/robots.txt
Domain IPs 173.209.36.131
Response IP 173.209.36.131
Found Yes
Hash 1f0d5217a0ffdbf11b873c7870726348128e2cd082a184b6626f01903986954d
SimHash 997889410d92

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login/
Disallow /readme.html
Disallow /listing-author/
Disallow /refer/
Disallow /feed/
Disallow /listingfeatures/
Disallow /*.html
Disallow /*.htm
Disallow /*.asp*
Disallow /*//1000
Disallow /*/?amp
Allow /wp-content/uploads/
Back to top

Other Records

Field Value
sitemap https://transcanadahighway.com/sitemap.xml
sitemap https://transcanadahighway.com/post-sitemap.xml
sitemap https://transcanadahighway.com/page-sitemap.xml
sitemap https://transcanadahighway.com/page-sitemap2.xml
sitemap https://transcanadahighway.com/listing-sitemap.xml
sitemap https://transcanadahighway.com/listing-sitemap2.xml
sitemap https://transcanadahighway.com/listing-sitemap3.xml
sitemap https://transcanadahighway.com/listing-sitemap4.xml
sitemap https://transcanadahighway.com/listing-sitemap5.xml
sitemap https://transcanadahighway.com/listing-sitemap6.xml
sitemap https://transcanadahighway.com/listing-sitemap7.xml
sitemap https://transcanadahighway.com/listing-sitemap8.xml
sitemap https://transcanadahighway.com/listing-sitemap9.xml
sitemap https://transcanadahighway.com/listing-sitemap10.xml
sitemap https://transcanadahighway.com/listing-sitemap11.xml
sitemap https://transcanadahighway.com/listing-sitemap12.xml
sitemap https://transcanadahighway.com/listing-sitemap13.xml
sitemap https://transcanadahighway.com/listing-sitemap14.xml
sitemap https://transcanadahighway.com/category-sitemap.xml
sitemap https://transcanadahighway.com/listing-category-sitemap.xml
sitemap https://transcanadahighway.com/location-sitemap.xml
Back to top

Comments

  • For domain: transcanadahighway.com
  • All robots will spider the domain
  • Don't spider private subfolders
Back to top