sexvideos20.com
robots.txt
Robots Exclusion Standard data for sexvideos20.com
Resource Scan
Scan Details
Site Domain | sexvideos20.com |
Base Domain | sexvideos20.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-05T01:34:44+00:00 |
Next Scan | 2024-11-04T01:34:44+00:00 |
Last Successful Scan
Scanned | 2024-04-16T00:22:27+00:00 |
URL | https://sexvideos20.com/robots.txt |
Domain IPs | 88.208.52.48 |
Response IP | 88.208.52.48 |
Found | Yes |
Hash | 5330591a1ac25cf7a4985f0c3870c6ae773464f7de537cafbeaec13cc6d3e3ab |
SimHash | 5b5d4d427a81 |
Groups
*
Rule | Path |
---|---|
Disallow | /o/* |
Disallow | /r/* |
Disallow | /ad.php |
Disallow | /sl.php |
Disallow | /pre.php |
Disallow | /nat.php |