samplepro.ru
robots.txt
Robots Exclusion Standard data for samplepro.ru
Resource Scan
Scan Details
Site Domain | samplepro.ru |
Base Domain | samplepro.ru |
Scan Status | Ok |
Last Scan | 2024-11-16T23:58:08+00:00 |
Next Scan | 2024-11-23T23:58:08+00:00 |
Last Scan
Scanned | 2024-11-16T23:58:08+00:00 |
URL | https://samplepro.ru/robots.txt |
Domain IPs | 212.193.52.122 |
Response IP | 212.193.52.122 |
Found | Yes |
Hash | a46593cd30f7b3a404a505f03d6ea9e476c3f477e14a3f06532b72c85f5615fe |
SimHash | 300c82d0e591 |
Groups
*
Rule | Path |
---|---|
Disallow | /backup/ |
Disallow | /language/ |
Disallow | /user/ |
Disallow | /tags/ |
Disallow | /2014/ |
Disallow | /2015/ |
Disallow | /newposts/ |
Disallow | /sf/ |
Disallow | /xfsearch/ |
Disallow | |
Disallow | /*subaction%3D |
Disallow | /*do%3D |
Disallow | /statistics.html |
Disallow | /rules.html |
Disallow | /dle-rules-page.html |
Disallow | /wecoolgays.php |
Disallow | /lastnews |
Other Records
Field | Value |
---|---|
sitemap | https://samplepro.ru/sitemap.xml |
Warnings
- `host` is not a known field.