web-db.org
robots.txt
Robots Exclusion Standard data for web-db.org
Resource Scan
Scan Details
| Site Domain | web-db.org |
| Base Domain | web-db.org |
| Scan Status | Ok |
| Last Scan | 2025-12-13T06:20:42+00:00 |
| Next Scan | 2025-12-20T06:20:42+00:00 |
Last Scan
| Scanned | 2025-12-13T06:20:42+00:00 |
| URL | https://web-db.org/robots.txt |
| Domain IPs | 85.25.203.30 |
| Response IP | 85.25.203.30 |
| Found | Yes |
| Hash | 542fe53378ca6ddac8b40fe299b612236cd3962e52fc4dcbb6e56411b18259b8 |
| SimHash | 4a574c606318 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /out.php |
| Disallow | /peoples/search |
| Disallow | /homonyms/search |
| Disallow | /schools/search |
| Disallow | /universities/search |
| Disallow | /military/search |
| Disallow | /companies/search |
| Disallow | /dating/search |
| Disallow | /pages |
| Disallow | /goto/?sn= |
| Disallow | *?action=delete |
yandex
| Rule | Path |
|---|---|
| Disallow | /out.php |
| Disallow | /peoples/search |
| Disallow | /homonyms/search |
| Disallow | /schools/search |
| Disallow | /universities/search |
| Disallow | /military/search |
| Disallow | /companies/search |
| Disallow | /dating/search |
| Disallow | /pages |
| Disallow | /goto/?sn= |
| Disallow | *?action=delete |
| Disallow | *?amp=1 |
| Disallow | *disptype%3Dfull-listing |
Warnings
- `clean-param` is not a known field.