castanetautomall.com
robots.txt

Robots Exclusion Standard data for castanetautomall.com

Resource Scan

Scan Details

Site Domain castanetautomall.com
Base Domain castanetautomall.com
Scan Status Ok
Last Scan2024-11-11T09:37:00+00:00
Next Scan 2024-11-18T09:37:00+00:00

Last Scan

Scanned2024-11-11T09:37:00+00:00
URL https://castanetautomall.com/robots.txt
Redirect https://www.castanetautomall.com/robots.txt
Redirect Domain www.castanetautomall.com
Redirect Base castanetautomall.com
Domain IPs 104.26.4.146, 104.26.5.146, 172.67.71.14, 2606:4700:20::681a:492, 2606:4700:20::681a:592, 2606:4700:20::ac43:470e
Redirect IPs 104.26.4.146, 104.26.5.146, 172.67.71.14, 2606:4700:20::681a:492, 2606:4700:20::681a:592, 2606:4700:20::ac43:470e
Response IP 172.67.71.14
Found Yes
Hash 0170186292ed0913bd50173fb46aa9fc5c60135a1eb7ee451c9b2bcdb4f422a6
SimHash 8856045ae601

Groups

ahrefsbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /dealeradmin/
Disallow /troy/
Disallow /cdn-cgi/