selectaware.com
robots.txt
Robots Exclusion Standard data for selectaware.com
Resource Scan
Scan Details
| Site Domain | selectaware.com |
| Base Domain | selectaware.com |
| Scan Status | Ok |
| Last Scan | 2024-10-27T12:26:40+00:00 |
| Next Scan | 2024-11-03T12:26:40+00:00 |
Last Scan
| Scanned | 2024-10-27T12:26:40+00:00 |
| URL | https://selectaware.com/robots.txt |
| Redirect | https://www.selectaware.com/robots.txt |
| Redirect Domain | www.selectaware.com |
| Redirect Base | selectaware.com |
| Domain IPs | 172.66.40.61, 172.66.43.195, 2606:4700:3108::ac42:283d, 2606:4700:3108::ac42:2bc3 |
| Redirect IPs | 172.66.40.61, 172.66.43.195, 2606:4700:3108::ac42:283d, 2606:4700:3108::ac42:2bc3 |
| Response IP | 172.66.40.61 |
| Found | Yes |
| Hash | debccea663d1514f912aadc5e175f47e543b152e0379b1000c7e1fc289800cdb |
| SimHash | 1e645050c408 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /redeemoffer.php |
| Disallow | /redeememailoffer.php |
| Disallow | /out/ |
| Disallow | /support |
| Disallow | /checks |
| Disallow | /static |
| Disallow | /info/static |
| Disallow | /categories/static |
| Disallow | /categories/coupons/static |
| Disallow | /categories/coupons/static |
| Disallow | /categories/coupons/coupons.html |
| Disallow | /marketing |
| Disallow | /ajax* |
| Disallow | /search.php |
| Disallow | /blog/cgi-bin/ |
| Disallow | /blog/z/j/ |
| Disallow | /blog/z/c/ |
| Disallow | /blog/stats/ |
| Disallow | /blog/dh_ |
| Disallow | /blog/contact/ |
| Disallow | /blog/tag/ |
| Disallow | /blog/wp-admin/ |
| Disallow | /blog/wp-includes/ |
| Disallow | /blog/contact |
| Disallow | /blog/manual |
| Disallow | /blog/manual/* |
| Disallow | /blog/phpmanual/ |
| Disallow | /blog/category/ |
| Disallow | /dataentrymanagement |
| Disallow | /webmanagement |
| Disallow | /*?tags=* |
| Disallow | /*?*tag=true* |
| Disallow | /tstcrwlscrps.php |
adidxbot
bingbot
| Rule | Path |
|---|---|
| Disallow | /stores/*/coupons/* |
| Disallow | /categories/*/coupons/* |
| Disallow | /search.php |
| Disallow | /site/* |
| Disallow | /pdeal |
| Disallow | /categories/coupons/showcouponoverlay.php |
| Disallow | /categories/coupons/couponpoptop_v2.php |
| Disallow | /redeemoffer.php |
| Disallow | /redeememailoffer.php |
| Disallow | /out/ |
| Disallow | /support |
| Disallow | /checks |
| Disallow | /static |
| Disallow | /info/static |
| Disallow | /categories/static |
| Disallow | /categories/coupons/static |
| Disallow | /categories/coupons/static |
| Disallow | /categories/coupons/coupons.html |
| Disallow | /marketing |
| Disallow | /ajax* |
| Disallow | /blog/cgi-bin/ |
| Disallow | /blog/z/j/ |
| Disallow | /blog/z/c/ |
| Disallow | /blog/stats/ |
| Disallow | /blog/dh_ |
| Disallow | /blog/contact/ |
| Disallow | /blog/tag/ |
| Disallow | /blog/wp-admin/ |
| Disallow | /blog/wp-includes/ |
| Disallow | /blog/wp-content/ |
| Disallow | /blog/contact |
| Disallow | /blog/manual |
| Disallow | /blog/manual/* |
| Disallow | /blog/phpmanual/ |
| Disallow | /blog/category/ |
| Disallow | /dataentrymanagement |
| Disallow | /webmanagement |
| Disallow | /*?tags=* |
| Disallow | /*?*tag=true* |
| Disallow | /tstcrwlscrps.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.selectaware.com/sitemap.xml |
Warnings
- 2 invalid lines.
Comments