prosconsreviews.com
robots.txt
Robots Exclusion Standard data for prosconsreviews.com
Resource Scan
Scan Details
Site Domain | prosconsreviews.com |
Base Domain | prosconsreviews.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-06-04T10:49:25+00:00 |
Next Scan | 2025-06-11T10:49:25+00:00 |
Last Successful Scan
Scanned | 2025-05-27T10:32:26+00:00 |
URL | https://prosconsreviews.com/robots.txt |
Domain IPs | 2a02:4780:38:2c1e:d620:944c:c56f:2f, 84.32.84.182 |
Response IP | 191.101.228.60 |
Found | Yes |
Hash | 7e17a6226e3f30c5141a4e00780cf1d8d13601f74d71885e824143c67ff21972 |
SimHash | d968c8c0a41a |
Groups
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Disallow | /wp-json/ |
Disallow | /?rest_route= |
Other Records
Field | Value |
---|---|
sitemap | https://prosconsreviews.com/sitemap.xml |
Comments