agnet.cz
robots.txt
Robots Exclusion Standard data for agnet.cz
Resource Scan
Scan Details
Site Domain | agnet.cz |
Base Domain | agnet.cz |
Scan Status | Ok |
Last Scan | 2024-09-08T08:18:48+00:00 |
Next Scan | 2024-10-08T08:18:48+00:00 |
Last Scan
Scanned | 2024-09-08T08:18:48+00:00 |
URL | https://agnet.cz/robots.txt |
Domain IPs | 3.73.27.108 |
Response IP | 3.73.27.108 |
Found | Yes |
Hash | 8b5fbcedb5cb69c4d9f6d1e06bd8b7703acd5ceebd1074e4c22bddf5f63cd752 |
SimHash | 6814dcd4c323 |
Groups
*
Rule | Path |
---|---|
Disallow | /servers/frontend/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://agnet.cz/sitemap.xml |