skipthefakes.com
robots.txt
Robots Exclusion Standard data for skipthefakes.com
Resource Scan
Scan Details
| Site Domain | skipthefakes.com |
| Base Domain | skipthefakes.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-17T13:50:25+00:00 |
| Next Scan | 2025-12-01T13:50:25+00:00 |
Last Successful Scan
| Scanned | 2025-10-09T02:49:11+00:00 |
| URL | https://skipthefakes.com/robots.txt |
| Domain IPs | 104.21.45.64, 172.67.210.188, 2606:4700:3033::6815:2d40, 2606:4700:3035::ac43:d2bc |
| Response IP | 172.67.210.188 |
| Found | Yes |
| Hash | 692f536b73a2975baefd80545bf558e1df9536cebead1a12c3b19e737fc54914 |
| SimHash | 6c08c8a3e4d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /feed/ |
| Disallow | /*/feed/ |
| Disallow | /?s= |
| Disallow | /*?replytocom= |
| Disallow | /*orderby%3D |
| Disallow | /*sort%3D |
| Disallow | /*filter%3D |
| Disallow | /*miles%3D |
| Disallow | /*distance%3D |
| Disallow | /*listing-page%3D |
| Disallow | /*paged%3D |
| Disallow | /*back_url%3D |
| Disallow | /*?* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://skipthefakes.com/sitemap_index.xml |
Comments