truckspring.com
robots.txt

Robots Exclusion Standard data for truckspring.com

Resource Scan

Scan Details

Site Domain truckspring.com
Base Domain truckspring.com
Scan Status Ok
Last Scan2024-11-17T19:54:08+00:00
Next Scan 2024-12-01T19:54:08+00:00

Last Scan

Scanned2024-11-17T19:54:08+00:00
URL https://truckspring.com/robots.txt
Redirect https://www.truckspring.com/robots.txt
Redirect Domain www.truckspring.com
Redirect Base truckspring.com
Domain IPs 151.101.130.132, 151.101.130.137, 151.101.194.132, 151.101.194.137, 151.101.2.132, 151.101.2.137, 151.101.66.132, 151.101.66.137
Redirect IPs 151.101.130.137, 151.101.194.137, 151.101.2.137, 151.101.66.137
Response IP 199.232.46.137
Found Yes
Hash e7880f4f75d61a3baca10246e256821813cde57d678de8d1451c9edf0aa54f4c
SimHash 5c5c8dc06410

Groups

*

Rule Path
Allow /
Disallow /login.aspx
Disallow /pwr/e43mxe78/rawdata/
Disallow /pwr/e43mxe78/debug.html
Disallow /PageNotFound.aspx
Disallow /blog/Account/*.*
Disallow /blog/search*
Disallow /blog/error404.aspx
Disallow /blog/archive*
Disallow /SearchByVehicle.aspx*
Disallow /SubmitReview.aspx*
Disallow /answerbox.aspx*
Disallow /Search.aspx*
Disallow /search.aspx*
Disallow /Cart.aspx*
Disallow /cart.aspx*
Disallow */checkout/*
Disallow *checkout.aspx*
Disallow *Checkout.aspx*
Disallow /*Error.aspx*
Disallow /*Profile.xml
Disallow /*Product.aspx*
Disallow /*Receipt.aspx*
Disallow /*LineItemId*
Disallow /*images-nwm*.html$

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

mauibot (crawler.feedback+dc@gmail.com)

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

openindexspider

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.truckspring.com/sitemap.xml

Comments

  • Sitemaps

Warnings

  • 2 invalid lines.