futureofnews.com
robots.txt
Robots Exclusion Standard data for futureofnews.com
Resource Scan
Scan Details
Site Domain | futureofnews.com |
Base Domain | futureofnews.com |
Scan Status | Ok |
Last Scan | 2024-09-20T14:26:51+00:00 |
Next Scan | 2024-10-20T14:26:51+00:00 |
Last Scan
Scanned | 2024-09-20T14:26:51+00:00 |
URL | https://futureofnews.com/robots.txt |
Domain IPs | 35.186.197.102 |
Response IP | 35.186.197.102 |
Found | Yes |
Hash | 2d85ad18fb9b24e9f0539e040bd154b9f20cd57522171488a924f9d3567a30d5 |
SimHash | 0bc6fb014012 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /AdEverywhere/Admin/ |
Disallow | /AdEverywhere/GroupAdmin/ |
Disallow | /AdEverywhere/MasterAdmin/ |
Disallow | /AdEverywhere/EnterpriseAdmin/ |
Disallow | /AdEverywhere/Data/ |
Disallow | /AdEverywhere/Test/ |
Disallow | /AdEverywhere/Ads/ |
Disallow | /AdEverywhere/CFCs/ |
Disallow | /AdEverywhere/ClearCache/ |
Disallow | /AdEverywhere/Custom/ |
Disallow | /AdEverywhere/ExcelData/ |
Disallow | /AdEverywhere/Files/ |
Disallow | /AdEverywhere/Help/ |
Disallow | /AdEverywhere/Hosted/ |
Disallow | /AdEverywhere/Images/ |
Disallow | /AdEverywhere/Includes/ |
Disallow | /AdEverywhere/MSI/ |
Disallow | /AdEverywhere/ScheduledTasks/ |
Disallow | /AdEverywhere/Style/ |
Disallow | /AdEverywhere/Temp/ |
Disallow | /AdEverywhere/TempFiles/ |
Disallow | /AdEverywhere/Test/ |
Disallow | /AdEverywhere/TwitterTest/ |
Disallow | /AdEverywhere/jquery-ui/ |
Disallow | /CFIDE/ |
Disallow | /Forums/ |
Disallow | /Original_Files/ |
Disallow | /PlaceMyAd/ |
Disallow | /Uploads/ |
Disallow | /cc/ |
Disallow | /cfide/ |
Disallow | /fonts/ |
Disallow | /hackmycf59/ |
Disallow | /images/ |
Disallow | /img_old/ |
Disallow | /js/ |
Disallow | /js_old/ |
Disallow | /mailformsubmit/ |
Disallow | /site_old/ |
Disallow | /test/ |
Disallow | /ckr/img/body/ |
Disallow | /ckr/img/nudes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
bingbot
Rule | Path |
---|---|
Disallow | /AdEverywhere/Admin/ |
Disallow | /AdEverywhere/GroupAdmin/ |
Disallow | /AdEverywhere/MasterAdmin/ |
Disallow | /AdEverywhere/EnterpriseAdmin/ |
Disallow | /AdEverywhere/Data/ |
Disallow | /AdEverywhere/Test/ |
Disallow | /AdEverywhere/Ads/ |
Disallow | /AdEverywhere/CFCs/ |
Disallow | /AdEverywhere/ClearCache/ |
Disallow | /AdEverywhere/Custom/ |
Disallow | /AdEverywhere/ExcelData/ |
Disallow | /AdEverywhere/Files/ |
Disallow | /AdEverywhere/Help/ |
Disallow | /AdEverywhere/Hosted/ |
Disallow | /AdEverywhere/Images/ |
Disallow | /AdEverywhere/Includes/ |
Disallow | /AdEverywhere/MSI/ |
Disallow | /AdEverywhere/ScheduledTasks/ |
Disallow | /AdEverywhere/Style/ |
Disallow | /AdEverywhere/Temp/ |
Disallow | /AdEverywhere/TempFiles/ |
Disallow | /AdEverywhere/Test/ |
Disallow | /AdEverywhere/TwitterTest/ |
Disallow | /AdEverywhere/jquery-ui/ |
Disallow | /CFIDE/ |
Disallow | /Forums/ |
Disallow | /Original_Files/ |
Disallow | /PlaceMyAd/ |
Disallow | /Uploads/ |
Disallow | /cc/ |
Disallow | /cfide/ |
Disallow | /fonts/ |
Disallow | /hackmycf59/ |
Disallow | /images/ |
Disallow | /img_old/ |
Disallow | /js/ |
Disallow | /js_old/ |
Disallow | /mailformsubmit/ |
Disallow | /site_old/ |
Disallow | /test/ |
Disallow | /ckr/img/body/ |
Disallow | /ckr/img/nudes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow | / |
Warnings
- 3 invalid lines.
- `ser-agent` is not a known field.