subarucalgary.com
robots.txt
Robots Exclusion Standard data for subarucalgary.com
Resource Scan
Scan Details
Site Domain | subarucalgary.com |
Base Domain | subarucalgary.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-06-13T00:23:47+00:00 |
Next Scan | 2025-09-11T00:23:47+00:00 |
Last Successful Scan
Scanned | 2022-09-09T09:36:46+00:00 |
URL | https://subarucalgary.com/robots.txt |
Response IP | 13.32.208.64 |
Found | Yes |
Hash | fd4338545afd28797fe3dad078364d8d6590146a8fc600276b74b7de685a4587 |
SimHash | 5964d2824521 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/ |
Disallow | /wp-admin/admin-ajax.php |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /readme.html |
Disallow | /refer/ |
Disallow | /data/ |
Disallow | /db/ |
Disallow | /scripts/ |
Disallow | /tools/ |
Disallow | /utils/ |
Disallow | /vendor/ |
Disallow | /fr/sitemap_index.xml |
Disallow | /en/sitemap_index.xml |
Disallow | *print/ |
Disallow | *?window_sticker |
Disallow | *?gclid |
Disallow | /*.svg$ |
sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
Product | Comment |
---|---|
sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm | 07) |
Rule | Path |
---|---|
Disallow | / |
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
Product | Comment |
---|---|
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm | 07) |
Rule | Path |
---|---|
Disallow | / |
Comments