startmycar.com
robots.txt
Robots Exclusion Standard data for startmycar.com
Resource Scan
Scan Details
Site Domain | startmycar.com |
Base Domain | startmycar.com |
Scan Status | Ok |
Last Scan | 2024-11-14T17:36:43+00:00 |
Next Scan | 2024-11-21T17:36:43+00:00 |
Last Scan
Scanned | 2024-11-14T17:36:43+00:00 |
URL | https://startmycar.com/robots.txt |
Redirect | https://www.startmycar.com/robots.txt |
Redirect Domain | www.startmycar.com |
Redirect Base | startmycar.com |
Domain IPs | 13.248.213.92, 15.197.149.68, 3.33.241.96, 76.223.57.73 |
Redirect IPs | 13.248.213.92, 15.197.149.68, 3.33.241.96, 76.223.57.73 |
Response IP | 76.223.57.73 |
Found | Yes |
Hash | 343e95d2bf30dad57edc78944b34ef6e163f0c688ce7fa16ccd8efb21b424c2f |
SimHash | f018df52e2a3 |
Groups
*
Rule | Path |
---|---|
Disallow | /miembros/perfil/* |
*
Rule | Path |
---|---|
Disallow | /*/miembros/perfil/* |
*
Rule | Path |
---|---|
Disallow | /members/profile/* |
*
Rule | Path |
---|---|
Disallow | /*/members/profile/* |
*
Rule | Path |
---|---|
Disallow | /membros/perfil/* |
*
Rule | Path |
---|---|
Disallow | /*/membros/perfil/* |
*
Rule | Path |
---|---|
Disallow | /auth/register/facebook |
simplepie
simplepie/1.1.3 (feed parser; http://simplepie.org; allow like gecko) build/20081219
synthesio
synthesio crawler release monalisa (contact at synthesio dot fr)
proximic
freefind
dblbot
seznambot
caliperbot
mj12bot
spbot
dotbot
omgilibot
omgili
semrushbot-sa
bytedance
bytespider
gptbot
chatgpt-user
ccbot
seekportbot
imagesiftbot
anthropic-ai
claudebot
claude-web
awariorssbot
awariosmartbot
cohere-ai
img2dataset
magpie-crawler
meltwater
piplbot
seekr
applebot-extended
Rule | Path |
---|---|
Disallow | / |