adeverywhere.com
robots.txt
Robots Exclusion Standard data for adeverywhere.com
Resource Scan
Scan Details
| Site Domain | adeverywhere.com |
| Base Domain | adeverywhere.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T22:04:29+00:00 |
| Next Scan | 2024-10-20T22:04:29+00:00 |
Last Scan
| Scanned | 2024-09-20T22:04:29+00:00 |
| URL | https://adeverywhere.com/robots.txt |
| Domain IPs | 35.186.208.207 |
| Response IP | 35.186.208.207 |
| Found | Yes |
| Hash | 2d85ad18fb9b24e9f0539e040bd154b9f20cd57522171488a924f9d3567a30d5 |
| SimHash | 0bc6fb014012 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /AdEverywhere/Admin/ |
| Disallow | /AdEverywhere/GroupAdmin/ |
| Disallow | /AdEverywhere/MasterAdmin/ |
| Disallow | /AdEverywhere/EnterpriseAdmin/ |
| Disallow | /AdEverywhere/Data/ |
| Disallow | /AdEverywhere/Test/ |
| Disallow | /AdEverywhere/Ads/ |
| Disallow | /AdEverywhere/CFCs/ |
| Disallow | /AdEverywhere/ClearCache/ |
| Disallow | /AdEverywhere/Custom/ |
| Disallow | /AdEverywhere/ExcelData/ |
| Disallow | /AdEverywhere/Files/ |
| Disallow | /AdEverywhere/Help/ |
| Disallow | /AdEverywhere/Hosted/ |
| Disallow | /AdEverywhere/Images/ |
| Disallow | /AdEverywhere/Includes/ |
| Disallow | /AdEverywhere/MSI/ |
| Disallow | /AdEverywhere/ScheduledTasks/ |
| Disallow | /AdEverywhere/Style/ |
| Disallow | /AdEverywhere/Temp/ |
| Disallow | /AdEverywhere/TempFiles/ |
| Disallow | /AdEverywhere/Test/ |
| Disallow | /AdEverywhere/TwitterTest/ |
| Disallow | /AdEverywhere/jquery-ui/ |
| Disallow | /CFIDE/ |
| Disallow | /Forums/ |
| Disallow | /Original_Files/ |
| Disallow | /PlaceMyAd/ |
| Disallow | /Uploads/ |
| Disallow | /cc/ |
| Disallow | /cfide/ |
| Disallow | /fonts/ |
| Disallow | /hackmycf59/ |
| Disallow | /images/ |
| Disallow | /img_old/ |
| Disallow | /js/ |
| Disallow | /js_old/ |
| Disallow | /mailformsubmit/ |
| Disallow | /site_old/ |
| Disallow | /test/ |
| Disallow | /ckr/img/body/ |
| Disallow | /ckr/img/nudes/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /AdEverywhere/Admin/ |
| Disallow | /AdEverywhere/GroupAdmin/ |
| Disallow | /AdEverywhere/MasterAdmin/ |
| Disallow | /AdEverywhere/EnterpriseAdmin/ |
| Disallow | /AdEverywhere/Data/ |
| Disallow | /AdEverywhere/Test/ |
| Disallow | /AdEverywhere/Ads/ |
| Disallow | /AdEverywhere/CFCs/ |
| Disallow | /AdEverywhere/ClearCache/ |
| Disallow | /AdEverywhere/Custom/ |
| Disallow | /AdEverywhere/ExcelData/ |
| Disallow | /AdEverywhere/Files/ |
| Disallow | /AdEverywhere/Help/ |
| Disallow | /AdEverywhere/Hosted/ |
| Disallow | /AdEverywhere/Images/ |
| Disallow | /AdEverywhere/Includes/ |
| Disallow | /AdEverywhere/MSI/ |
| Disallow | /AdEverywhere/ScheduledTasks/ |
| Disallow | /AdEverywhere/Style/ |
| Disallow | /AdEverywhere/Temp/ |
| Disallow | /AdEverywhere/TempFiles/ |
| Disallow | /AdEverywhere/Test/ |
| Disallow | /AdEverywhere/TwitterTest/ |
| Disallow | /AdEverywhere/jquery-ui/ |
| Disallow | /CFIDE/ |
| Disallow | /Forums/ |
| Disallow | /Original_Files/ |
| Disallow | /PlaceMyAd/ |
| Disallow | /Uploads/ |
| Disallow | /cc/ |
| Disallow | /cfide/ |
| Disallow | /fonts/ |
| Disallow | /hackmycf59/ |
| Disallow | /images/ |
| Disallow | /img_old/ |
| Disallow | /js/ |
| Disallow | /js_old/ |
| Disallow | /mailformsubmit/ |
| Disallow | /site_old/ |
| Disallow | /test/ |
| Disallow | /ckr/img/body/ |
| Disallow | /ckr/img/nudes/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 3 invalid lines.
- `ser-agent` is not a known field.