canoncityclassifieds.com
robots.txt
Robots Exclusion Standard data for canoncityclassifieds.com
Resource Scan
Scan Details
| Site Domain | canoncityclassifieds.com |
| Base Domain | canoncityclassifieds.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T09:29:29+00:00 |
| Next Scan | 2024-10-21T09:29:29+00:00 |
Last Scan
| Scanned | 2024-09-21T09:29:29+00:00 |
| URL | https://canoncityclassifieds.com/robots.txt |
| Domain IPs | 35.208.225.57 |
| Response IP | 35.208.225.57 |
| Found | Yes |
| Hash | f7773033814ba548256b16b195c9c8950701f76426981e05431c28c76c5c80a0 |
| SimHash | 4e5efa14b413 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /AdEverywhere/Admin/ |
| Disallow | /AdEverywhere/GroupAdmin/ |
| Disallow | /AdEverywhere/MasterAdmin/ |
| Disallow | /AdEverywhere/EnterpriseAdmin/ |
| Disallow | /AdEverywhere/AdminSelector/ |
| Disallow | /AdEverywhere/Cache/ |
| Disallow | /AdEverywhere/EnterpriseAdminTest/ |
| Disallow | /AdEverywhere/Images/ |
| Disallow | /AdEverywhere/Includes/ |
| Disallow | /AdEverywhere/StaticHeaders/ |
| Disallow | /AdEverywhere/Style/ |
| Disallow | /AdEverywhere/Utilities/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /AdEverywhere/Admin/ |
| Disallow | /AdEverywhere/GroupAdmin/ |
| Disallow | /AdEverywhere/MasterAdmin/ |
| Disallow | /AdEverywhere/EnterpriseAdmin/ |
| Disallow | /AdEverywhere/AdminSelector/ |
| Disallow | /AdEverywhere/Cache/ |
| Disallow | /AdEverywhere/EnterpriseAdminTest/ |
| Disallow | /AdEverywhere/Images/ |
| Disallow | /AdEverywhere/Includes/ |
| Disallow | /AdEverywhere/StaticHeaders/ |
| Disallow | /AdEverywhere/Style/ |
| Disallow | /AdEverywhere/Utilities/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | / |