91wheels.com
robots.txt

Robots Exclusion Standard data for 91wheels.com

Resource Scan

Scan Details

Site Domain 91wheels.com
Base Domain 91wheels.com
Scan Status Ok
Last Scan2024-05-03T17:57:26+00:00
Next Scan 2024-05-10T17:57:26+00:00

Last Scan

Scanned2024-05-03T17:57:26+00:00
URL https://91wheels.com/robots.txt
Redirect https://www.91wheels.com:443/robots.txt
Redirect Domain www.91wheels.com
Redirect Base 91wheels.com
Domain IPs 108.157.254.116, 108.157.254.117, 108.157.254.49, 108.157.254.97
Redirect IPs 108.157.254.116, 108.157.254.117, 108.157.254.49, 108.157.254.97
Response IP 108.157.254.97
Found Yes
Hash a1539c3ca0fd3b8bf2442a7e7150e6477dbc9d090219472c50d9d06597d00fcd
SimHash 4501c8c0c311

Groups

mediapartners-google

Rule Path
Allow /

petalbot
baiduspider
baiduspider-video
baiduspider-image
yandex
yandexbot
mj12bot
zoominfobot
gptbot
bytespider

Rule Path
Disallow /

*

Rule Path
Allow *.js
Allow *.css
Disallow /*?amp*
Disallow /assets/*
Disallow /dealers/*
Disallow /dealers/*
Disallow *variant%3D*
Disallow *call_custom_simple_rss*

Other Records

Field Value
sitemap https://www.91wheels.com/sitemap/sitemap.xml