dle-faq.ru
robots.txt
Robots Exclusion Standard data for dle-faq.ru
Resource Scan
Scan Details
Site Domain | dle-faq.ru |
Base Domain | dle-faq.ru |
Scan Status | Ok |
Last Scan | 2024-10-31T19:37:55+00:00 |
Next Scan | 2024-11-07T19:37:55+00:00 |
Last Scan
Scanned | 2024-10-31T19:37:55+00:00 |
URL | https://dle-faq.ru/robots.txt |
Domain IPs | 185.198.166.82 |
Response IP | 185.198.166.82 |
Found | Yes |
Hash | 6532b70daffe2a495ef9fcb415347af14ebce5130044391848093c3bda5a013c |
SimHash | ed009722e3d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/ |
Disallow | /user/ |
Disallow | /index.php?do= |
Disallow | *?do= |
Disallow | /index.php?cstart= |
Disallow | /?cstart= |
Disallow | /page/ |
Disallow | /search.html |
Disallow | /notchecked/ |
Disallow | /rss_comm |
Disallow | *?cstart= |
Disallow | *do%3Dusers |
Disallow | *do%3Dmembers |
Disallow | *newsid%3D |
Disallow | *PageSpeed%3D |
Other Records
Field | Value |
---|---|
sitemap | https://dle-faq.ru/sitemap.xml |
Warnings
- `host` is not a known field.