bigauto.info
robots.txt
Robots Exclusion Standard data for bigauto.info
Resource Scan
Scan Details
Site Domain | bigauto.info |
Base Domain | bigauto.info |
Scan Status | Ok |
Last Scan | 2024-09-27T09:28:36+00:00 |
Next Scan | 2024-10-04T09:28:36+00:00 |
Last Scan
Scanned | 2024-09-27T09:28:36+00:00 |
URL | https://bigauto.info/robots.txt |
Domain IPs | 92.255.76.9 |
Response IP | 92.255.76.9 |
Found | Yes |
Hash | a75ab5d92fc6243feff911ec11913e333d343a3f0578984375aa61093bc18d8e |
SimHash | 0009c1428534 |
Groups
yandex
Rule | Path |
---|---|
Allow | / |
Disallow | /manager/ |
Disallow | /assets/components/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /index.php |
Disallow | *? |
googlebot
Rule | Path |
---|---|
Allow | / |
Disallow | /manager/ |
Disallow | /assets/components/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /index.php |
Disallow | *? |
bing
Rule | Path |
---|---|
Allow | / |
Disallow | /manager/ |
Disallow | /assets/components/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /index.php |
Disallow | *? |
mail.ru
Rule | Path |
---|---|
Allow | / |
Disallow | /manager/ |
Disallow | /assets/components/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /index.php |
Disallow | *? |
aport
Rule | Path |
---|---|
Allow | / |
Disallow | /manager/ |
Disallow | /assets/components/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /index.php |
Disallow | *? |
stackrambler
Rule | Path |
---|---|
Allow | / |
Disallow | /manager/ |
Disallow | /assets/components/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /index.php |
Disallow | *? |
slurp
Rule | Path |
---|---|
Allow | / |
Disallow | /manager/ |
Disallow | /assets/components/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /index.php |
Disallow | *? |
Other Records
Field | Value |
---|---|
sitemap | https://bigauto.info/sitemap.xml |
Warnings
- `host` is not a known field.