xfreesex.com
robots.txt
Robots Exclusion Standard data for xfreesex.com
Resource Scan
Scan Details
Site Domain | xfreesex.com |
Base Domain | xfreesex.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-31T23:23:34+00:00 |
Next Scan | 2024-11-14T23:23:34+00:00 |
Last Successful Scan
Scanned | 2024-09-23T23:22:28+00:00 |
URL | https://xfreesex.com/robots.txt |
Domain IPs | 104.21.76.148, 172.67.196.63, 2606:4700:3031::6815:4c94, 2606:4700:3033::ac43:c43f |
Response IP | 104.21.76.148 |
Found | Yes |
Hash | 9f2ce17389975caef392f1b9c1715056d3e7d2c3a35a227af6348476cbe69581 |
SimHash | 6307677329a7 |
Groups
*
Rule | Path |
---|---|
Disallow | /legal/ |
Disallow | /search.php |
Warnings
- 10 invalid lines.