dozorro.org
robots.txt
Robots Exclusion Standard data for dozorro.org
Resource Scan
Scan Details
Site Domain | dozorro.org |
Base Domain | dozorro.org |
Scan Status | Ok |
Last Scan | 2025-05-10T07:20:54+00:00 |
Next Scan | 2025-06-09T07:20:54+00:00 |
Last Scan
Scanned | 2025-05-10T07:20:54+00:00 |
URL | https://dozorro.org/robots.txt |
Domain IPs | 104.21.26.39, 172.67.135.91, 2606:4700:3035::6815:1a27, 2606:4700:3036::ac43:875b |
Response IP | 104.21.26.39 |
Found | Yes |
Hash | 3e31c18ac721b3801e3093579a5ed9a1bedcfa90f16e7d923cadb8310f5bb753 |
SimHash | fb95c056ca10 |
Groups
*
Rule | Path |
---|---|
Disallow | /form/ |
Disallow | /user/ |
Disallow | /profile/ |
Disallow | /search |
Disallow | /tender/search |
Disallow | /youcontrol/ |
Disallow | /filestorage/ |
Disallow | /helpers/download/ |
Disallow | /tender/UA-2020-04-06-003064-b |
Disallow | /tender/UA-2024-01-31-003532-a |
Disallow | /tender/UA-2023-12-15-015039-a |
Disallow | /tender/UA-2023-11-14-013516-a |
Disallow | /tender/UA-2023-10-05-007717-a |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://dozorro.org/sitemap.xml |