startmycar.com
robots.txt

Robots Exclusion Standard data for startmycar.com

Resource Scan

Scan Details

Site Domain startmycar.com
Base Domain startmycar.com
Scan Status Ok
Last Scan2024-11-14T17:36:43+00:00
Next Scan 2024-11-21T17:36:43+00:00

Last Scan

Scanned2024-11-14T17:36:43+00:00
URL https://startmycar.com/robots.txt
Redirect https://www.startmycar.com/robots.txt
Redirect Domain www.startmycar.com
Redirect Base startmycar.com
Domain IPs 13.248.213.92, 15.197.149.68, 3.33.241.96, 76.223.57.73
Redirect IPs 13.248.213.92, 15.197.149.68, 3.33.241.96, 76.223.57.73
Response IP 76.223.57.73
Found Yes
Hash 343e95d2bf30dad57edc78944b34ef6e163f0c688ce7fa16ccd8efb21b424c2f
SimHash f018df52e2a3

Groups

*

Rule Path
Disallow /miembros/perfil/*

*

Rule Path
Disallow /*/miembros/perfil/*

*

Rule Path
Disallow /members/profile/*

*

Rule Path
Disallow /*/members/profile/*

*

Rule Path
Disallow /membros/perfil/*

*

Rule Path
Disallow /*/membros/perfil/*

*

Rule Path
Disallow /auth/register/facebook

simplepie
simplepie/1.1.3 (feed parser; http://simplepie.org; allow like gecko) build/20081219
synthesio
synthesio crawler release monalisa (contact at synthesio dot fr)
proximic
freefind
dblbot
seznambot
caliperbot
mj12bot
spbot
dotbot
omgilibot
omgili
semrushbot-sa
bytedance
bytespider
gptbot
chatgpt-user
ccbot
seekportbot
imagesiftbot
anthropic-ai
claudebot
claude-web
awariorssbot
awariosmartbot
cohere-ai
img2dataset
magpie-crawler
meltwater
piplbot
seekr
applebot-extended

Rule Path
Disallow /