autoexus.com
robots.txt

Robots Exclusion Standard data for autoexus.com

Resource Scan

Scan Details

Site Domain autoexus.com
Base Domain autoexus.com
Scan Status Ok
Last Scan2025-08-21T09:49:49+00:00
Next Scan 2025-09-04T09:49:49+00:00

Last Scan

Scanned2025-08-21T09:49:49+00:00
URL https://autoexus.com/robots.txt
Domain IPs 162.55.185.146
Response IP 162.55.185.146
Found Yes
Hash 28c05c85e54ebdcf112edb67107a3364896ca43982310a35b719f1385635c725
SimHash 777dd470621b

Groups

*

Rule Path
Allow /

semrushbot
dataforseobot
mj12bot
seekport
dotbot
petalbot
blexbot
linkpadbot
sputnikbot
statdom.ru
megaindex.ru
webdatastats
jooblebot
backupland
netcraftsurveyagent
openstat.ru

Rule Path
Disallow /

gptbot
ahrefsbot
chatgpt-user

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10