castanetautomall.com
robots.txt

Robots Exclusion Standard data for castanetautomall.com

Resource Scan

Scan Details

Site Domain castanetautomall.com
Base Domain castanetautomall.com
Scan Status Ok
Last Scan2024-05-27T04:40:20+00:00
Next Scan 2024-06-03T04:40:20+00:00

Last Scan

Scanned2024-05-27T04:40:20+00:00
URL https://castanetautomall.com/robots.txt
Redirect https://www.castanetautomall.com/robots.txt
Redirect Domain www.castanetautomall.com
Redirect Base castanetautomall.com
Domain IPs 104.26.4.146, 104.26.5.146, 172.67.71.14, 2606:4700:20::681a:492, 2606:4700:20::681a:592, 2606:4700:20::ac43:470e
Redirect IPs 104.26.4.146, 104.26.5.146, 172.67.71.14, 2606:4700:20::681a:492, 2606:4700:20::681a:592, 2606:4700:20::ac43:470e
Response IP 104.26.5.146
Found Yes
Hash 17bc6e3e8228b5a6c29d4c77e9190cc2dd296f83e01a50b7caa9c832b490ed87
SimHash c056445ae601

Groups

ahrefsbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /dealeradmin/
Disallow /troy/
Disallow /cdn-cgi/