sexxasch.com
robots.txt
Robots Exclusion Standard data for sexxasch.com
Resource Scan
Scan Details
Site Domain | sexxasch.com |
Base Domain | sexxasch.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-01-12T23:13:46+00:00 |
Next Scan | 2025-04-12T23:13:46+00:00 |
Last Successful Scan
Scanned | 2024-05-25T23:08:35+00:00 |
URL | https://sexxasch.com/robots.txt |
Domain IPs | 104.21.16.218, 172.67.216.62, 2606:4700:3030::6815:10da, 2606:4700:3033::ac43:d83e |
Response IP | 104.21.16.218 |
Found | Yes |
Hash | e4fca9230fa779f185605d3f0c96c36a87e0f3cb9442365b9978cf12af7f75b8 |
SimHash | f118c6eb2ea0 |
Groups
*
Rule | Path |
---|---|
Disallow | /my/ |
Disallow | /agent/ |
Disallow | /my/join.php |
Disallow | /404/ |
Disallow | /help/ |
Disallow | /oplata/ |
Disallow | /policy/ |
Disallow | /reklama/ |
Disallow | /search/ |
Disallow | /trans/ |
Disallow | /viewed/ |
Disallow | /booking/ |
Disallow | /usloviy/ |
Disallow | /*?* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Warnings
- `host` is not a known field.