xpressautoinc.com
robots.txt

Robots Exclusion Standard data for xpressautoinc.com

Resource Scan

Scan Details

Site Domain xpressautoinc.com
Base Domain xpressautoinc.com
Scan Status Ok
Last Scan5/19/2025, 9:43:24 AM
Next Scan 6/18/2025, 9:43:24 AM

Last Scan

Scanned5/19/2025, 9:43:24 AM
URL https://xpressautoinc.com/robots.txt
Redirect https://www.xpressautoinc.com/robots.txt
Redirect Domain www.xpressautoinc.com
Redirect Base xpressautoinc.com
Domain IPs 104.21.28.222, 172.67.147.188, 2606:4700:3030::ac43:93bc, 2606:4700:3035::6815:1cde
Redirect IPs 104.21.28.222, 172.67.147.188, 2606:4700:3030::ac43:93bc, 2606:4700:3035::6815:1cde
Response IP 104.21.28.222
Found Yes
Hash 9756a6ffc7d762067fc8fea9fc5d767d8bba1724b7ae30e6ca31c084da8ec0bb
SimHash 635fc8708fa4

Groups

yandex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

semalt

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

polite-crawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /secure-finance-application/?iid=*

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /*?*bodystyle=*
Disallow /*?*pricelow=*
Disallow /*?*pricehigh=*
Disallow /*?*yearlow=*
Disallow /*?*yearhigh=*
Disallow /*?*mileagelow=*
Disallow /*?*mileagehigh=*
Disallow /*?*transmission=*
Disallow /*?*extcolor=*
Disallow /*?*cxID=*
Disallow /*?*fuelecon=*
Disallow /*?*location=*
Disallow /*?*status=*
Disallow /*?*show=*
Disallow /*?*sort=*
Disallow /secure-finance-application/*
Disallow /*?*siteID=*
Disallow /*?*fType=*
Disallow /*?*fMake=*
Disallow /*?*fModel=*
Disallow /*?*fTrim=*
Disallow /*?*fYear=*
Disallow /*?*fExtColor=*
Disallow /*?*fIntColor=*
Disallow /*?*fHwyMPG=*
Disallow /*?*fCityMPG=*
Disallow /*?*fCondition=*
Disallow /*?*fFuelType=*
Disallow /*?*fLoc=*
Disallow /*?*fDrive=*
Disallow /*?*fTrans=*
Disallow /*?*fMileage=*

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /*?*bodystyle=*
Disallow /*?*pricelow=*
Disallow /*?*pricehigh=*
Disallow /*?*yearlow=*
Disallow /*?*yearhigh=*
Disallow /*?*mileagelow=*
Disallow /*?*mileagehigh=*
Disallow /*?*transmission=*
Disallow /*?*extcolor=*
Disallow /*?*cxID=*
Disallow /*?*fuelecon=*
Disallow /*?*location=*
Disallow /*?*status=*
Disallow /*?*show=*
Disallow /*?*sort=*
Disallow /secure-finance-application/*