bestproductsreviews.com
robots.txt
Robots Exclusion Standard data for bestproductsreviews.com
Resource Scan
Scan Details
Site Domain | bestproductsreviews.com |
Base Domain | bestproductsreviews.com |
Scan Status | Ok |
Last Scan | 2024-11-11T08:53:30+00:00 |
Next Scan | 2024-11-18T08:53:30+00:00 |
Last Scan
Scanned | 2024-11-11T08:53:30+00:00 |
URL | https://bestproductsreviews.com/robots.txt |
Redirect | https://www.bestproductsreviews.com:443/robots.txt |
Redirect Domain | www.bestproductsreviews.com |
Redirect Base | bestproductsreviews.com |
Domain IPs | 45.60.240.15, 45.60.250.15 |
Redirect IPs | 45.60.244.15 |
Response IP | 45.60.244.15 |
Found | Yes |
Hash | 4a193036d697d1e2a3569aadfe35ead2f02cf588de5c38e478ac492780b7d8f0 |
SimHash | 60d559648353 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /p/ |
Disallow | /p/* |
Disallow | /remote/* |
Disallow | /redirect* |
Disallow | /*?sort= |
Disallow | /*?brands= |
Disallow | /*?conditions= |
Disallow | /*?sellers= |
Disallow | /js/visit-enrich |
Disallow | /user-action |
Disallow |
*
Rule | Path |
---|---|
Disallow | /p/ |
Disallow | /p/* |
Disallow | /remote/* |
Disallow | /redirect* |
Disallow | /*?sort= |
Disallow | /*?brands= |
Disallow | /*?conditions= |
Disallow | /*?sellers= |
Disallow | /user-action |
Disallow | /panel/words-to-remove |
Disallow | /panel/words-to-remove/modify |