sexohab.guru
robots.txt
Robots Exclusion Standard data for sexohab.guru
Resource Scan
Scan Details
Site Domain | sexohab.guru |
Base Domain | sexohab.guru |
Scan Status | Ok |
Last Scan | 2024-06-11T13:49:03+00:00 |
Next Scan | 2024-07-11T13:49:03+00:00 |
Last Scan
Scanned | 2024-06-11T13:49:03+00:00 |
URL | https://sexohab.guru/robots.txt |
Domain IPs | 104.21.8.251, 172.67.188.219, 2606:4700:3030::6815:8fb, 2606:4700:3035::ac43:bcdb |
Response IP | 172.67.188.219 |
Found | Yes |
Hash | b293e081ed7a75d4f3a01ce4375f0d48ef727621c3062d532a00651ec921c1a3 |
SimHash | f018d6eb2790 |
Groups
*
Rule | Path |
---|---|
Disallow | /my/ |
Disallow | /agent/ |
Disallow | /my/join.php |
Disallow | /404/ |
Disallow | /help/ |
Disallow | /reklama/ |
Disallow | /viewed/ |
Disallow | /search/ |
Disallow | /booking/ |
Disallow | /usloviy/ |
Disallow | /usloviy/ |
Disallow | /*?* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Warnings
- `host` is not a known field.