retailmenot.com
robots.txt
Robots Exclusion Standard data for retailmenot.com
Resource Scan
Scan Details
| Site Domain | retailmenot.com |
| Base Domain | retailmenot.com |
| Scan Status | Ok |
| Last Scan | 2024-10-02T01:57:34+00:00 |
| Next Scan | 2024-10-09T01:57:34+00:00 |
Last Scan
| Scanned | 2024-10-02T01:57:34+00:00 |
| URL | https://retailmenot.com/robots.txt |
| Redirect | https://www.retailmenot.com/robots.txt |
| Redirect Domain | www.retailmenot.com |
| Redirect Base | retailmenot.com |
| Domain IPs | 104.18.36.156, 172.64.151.100, 2606:4700:4400::6812:249c, 2606:4700:4400::ac40:9764 |
| Redirect IPs | 104.18.38.196, 172.64.149.60, 2606:4700:4400::6812:26c4, 2606:4700:4400::ac40:953c |
| Response IP | 172.64.149.60 |
| Found | Yes |
| Hash | b96dd3b99dea3a9e336e01571b9568a67953c04e771f1e2a1c2cc6ff6befc594 |
| SimHash | 084cd3722191 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /ajax/geoLocate.php |
| Disallow | /comment.php |
| Disallow | /coupons/blank-default |
| Disallow | /landing/ |
| Disallow | /landing.php |
| Disallow | /landing2/ |
| Disallow | /landing2.php |
| Disallow | /landing5/ |
| Disallow | /landing5.php |
| Disallow | /redeem/ |
| Disallow | /offer/ |
| Disallow | /out/ |
| Disallow | /out2/ |
| Disallow | /out_deals/ |
| Disallow | /out_frame/ |
| Disallow | /opening_this_will_get_you_banned.php |
| Disallow | /extension.php |
| Disallow | /showcoupon/ |
| Disallow | /showcpgcoupon/ |
| Disallow | /newsletter/ |
| Disallow | /xhprof/ |
| Disallow | /special |
| Disallow | /special.php |
| Disallow | /infographics/ |
| Disallow | */comment.php |
| Disallow | */vote.php |
| Disallow | /notify |
| Disallow | /nearby/ |
| Disallow | /s/ |
| Disallow | /submit |
| Disallow | /community/ |
| Disallow | /deals/ |
| Disallow | /labs/ |
| Disallow | /?c= |
| Disallow | /avatars |
| Disallow | /blog/wp-admin* |
| Disallow | /blog/wp-includes* |
| Disallow | /labs* |
| Disallow | /www/gui* |
| Disallow | /tng/* |
| Disallow | /my/* |
| Allow | /deals/blackfriday |
| Allow | /deals/christmas |
| Allow | /deals/cybermonday |
| Allow | /labs/dealsquad |
| Allow | /special/lowes-black-friday |
| Allow | /special/harbor-freight-black-friday |
| Allow | /static/privacy |
| Allow | /static/terms |
| Disallow | /ca/landing/ |
| Disallow | /ca/out/* |
| Disallow | /ca/showcoupon/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.retailmenot.com/sitemap.xml |
| sitemap | https://www.retailmenot.com/blog/sitemap_index.xml |
| sitemap | https://www.retailmenot.com/ca/sitemap.xml |
Warnings
- 2 invalid lines.
Comments